Jul 06 15:19:53 devstack cinder-volume[75080]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 15:19:53 devstack cinder-volume[75080]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:19:53 devstack cinder-volume[75080]: we strongly recommend against using it for new projects. Jul 06 15:19:53 devstack cinder-volume[75080]: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:19:53 devstack cinder-volume[75080]: framework. For more detail see Jul 06 15:19:53 devstack cinder-volume[75080]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:19:53 devstack cinder-volume[75080]: import eventlet # noqa Jul 06 15:19:56 devstack cinder-volume[75080]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:19:56 devstack cinder-volume[75080]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:19:56 devstack cinder-volume[75080]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:19:57 devstack cinder-volume[75080]: INFO dbcounter [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Registered counter for database cinder Jul 06 15:19:57 devstack cinder-volume[75080]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:19:57 devstack cinder-volume[75080]: DEBUG dbcounter [-] [75080] Writer thread running {{(pid=75080) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:19:57 devstack cinder-volume[75080]: INFO cinder.rpc [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 15:19:57 devstack cinder-volume[75080]: INFO cinder.rpc [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 15:19:57 devstack cinder-volume[75080]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:19:57 devstack cinder-volume[75080]: INFO cinder.volume.manager [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Determined volume DB was empty at startup. Jul 06 15:19:57 devstack cinder-volume[75080]: DEBUG cinder.volume.manager [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75080) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 15:19:57 devstack cinder-volume[75080]: INFO cinder.volume.manager [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 15:19:57 devstack cinder-volume[75080]: WARNING stevedore.named [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:19:57 devstack cinder-volume[75080]: WARNING castellan.key_manager [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:19:57 devstack cinder-volume[75080]: WARNING cinder.keymgr.conf_key_mgr [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:19:57 devstack cinder-volume[75080]: DEBUG cinder.volume.drivers.lvm [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75080) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 15:19:57 devstack cinder-volume[75080]: DEBUG oslo_concurrency.processutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_concurrency.processutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] CMD "cinder-rtstool verify" returned: 0 in 0.517s {{(pid=75080) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:19:58 devstack cinder-volume[75080]: INFO cinder.rpc [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 15:19:58 devstack cinder-volume[75080]: INFO cinder.rpc [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 15:19:58 devstack cinder-volume[75080]: WARNING stevedore.named [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:19:58 devstack cinder-volume[75080]: WARNING castellan.key_manager [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:19:58 devstack cinder-volume[75080]: INFO cinder.volume.manager [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75080) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:19:58 devstack cinder-volume[75080]: INFO oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Starting 1 workers Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Started child 75254 {{(pid=75080) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Full set of CONF: {{(pid=75080) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] ******************************************************************************** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Configuration options gathered from: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] ================================================================================ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] allow_availability_zone_fallback = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] allow_compression_on_image_upload = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] allowed_direct_url_schemes = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] api_rate_limit = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] auth_strategy = keystone {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] az_cache_duration = 3600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_availability_zone = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_host = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_stats_polling_interval = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backup_api_class = cinder.backup.api.API {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backup_name_template = backup-%s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backup_use_same_host = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backup_use_temp_snapshot = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75254]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] chap_password = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] chap_username = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_internal_tenant_project_id = 334a496138a344cbbc6c1b2d0921b60b {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_internal_tenant_user_id = cc70021d8a544db38d47cd341a0ad051 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cloned_volume_same_az = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cluster = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] compression_format = gzip {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] compute_api_class = cinder.compute.nova.API {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] config_dir = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] config_source = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] control_exchange = openstack {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] debug = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] default_availability_zone = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] default_group_type = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] default_volume_type = lvmdriver-1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] disk_geometry = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] driver_client_cert = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] driver_client_cert_key = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] driver_data_namespace = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] driver_ssl_cert_path = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] driver_ssl_cert_verify = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] driver_use_ssl = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] enable_force_upload = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] enable_new_services = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] enable_unsupported_driver = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] enforce_multipath_for_image_xfer = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] filter_function = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_api_insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_api_servers = ['http://192.168.122.172/image'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_api_ssl_compression = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_ca_certificates_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_catalog_info = image:glance:publicURL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_num_retries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance_request_timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] goodness_function = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] graceful_shutdown_timeout = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] group_api_class = cinder.group.api.API {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] host = devstack {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_compress_on_upload = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_conversion_address_space_limit = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_conversion_cpu_limit = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_conversion_disable = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_upload_use_cinder_backend = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_upload_use_internal_tenant = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_volume_cache_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_volume_cache_max_count = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] image_volume_cache_max_size_gb = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] init_host_max_objects_retrieval = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] instance_format = [instance: %(uuid)s] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] iscsi_target_flags = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] iscsi_write_cache = on {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] iser_helper = tgtadm {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack sudo[75258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] iser_ip_address = 192.168.122.172 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] iser_port = 3260 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_color = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_config_append = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack sudo[75258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_dir = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_options = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_rotate_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_rotate_interval_type = days {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] log_rotation_type = none {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] max_age = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] max_logfile_count = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] max_logfile_size_mb = 200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] max_over_subscription_ratio = 20.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] message_reap_interval = 86400 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] message_ttl = 2592000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] migration_create_volume_timeout_secs = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] monkey_patch = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] monkey_patch_modules = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] my_ip = 192.168.122.172 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] no_snapshot_gb_quota = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] num_iser_scan_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] num_shell_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] num_volume_device_scan_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] nvmeof_conn_info_version = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] nvmet_ns_id = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] nvmet_port_id = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_max_limit = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_volume_ext_list = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_volume_listen_port = 8776 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_volume_use_ssl = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] osapi_volume_workers = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] per_volume_size_limit = -1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] periodic_fuzzy_delay = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] periodic_interval = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] public_endpoint = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] publish_errors = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_backup_gigabytes = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_backups = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_gigabytes = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_groups = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_snapshots = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] quota_volumes = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] rate_limit_burst = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] rate_limit_except_level = CRITICAL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] rate_limit_interval = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] reinit_driver_count = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] replication_device = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] report_discard_supported = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] report_interval = 120 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] reservation_clean_interval = 86400 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] reservation_expire = 86400 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] reserved_image_namespaces = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] reserved_percentage = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] rpc_response_timeout = 120 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] run_external_periodic_tasks = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] scst_target_driver = iscsi {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] scst_target_iqn_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_down_time = 720 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] shell_completion = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] snapshot_name_template = snapshot-%s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] snapshot_same_host = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] state_path = /opt/stack/data/cinder {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] storage_availability_zone = nova {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] storage_protocol = iSCSI {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] syslog_log_facility = LOG_USER {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] target_helper = lioadm {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] target_ip_address = 192.168.122.172 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] target_port = 3260 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] target_protocol = iscsi {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] target_secondary_ip_addresses = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] trace_flags = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] transport_url = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] until_refresh = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_chap_auth = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_default_quota_class = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_journal = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_json = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_multipath_for_image_xfer = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_stderr = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] use_syslog = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] verify_glance_signatures = enabled {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_api_class = cinder.volume.api.API {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_backend_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_clear = zero {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_clear_ionice = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_clear_size = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_copy_bps_limit = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_dd_blocksize = 1M {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_name_template = volume-%s {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_service_inithost_offload = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volume_usage_audit_period = month {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] zoning_mode = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_concurrency.disable_process_locking = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: INFO cinder.volume.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.auth_section = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.auth_type = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.auth_version = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.cache = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.include_service_catalog = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.interface = public {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_password = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcache_username = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.region_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.service_token_roles_required = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.service_type = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.172/identity {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.backend = dogpile.cache.null {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.backend_argument = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.backend_expiration_time = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.config_prefix = cache.oslo {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.debug_cache_backend = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.enable_retry_client = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.enable_socket_keepalive = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.expiration_time = 600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.hashclient_retry_attempts = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_dead_retry = 300 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_pool_maxsize = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_sasl_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.password = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.proxies = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.redis_db = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.redis_server = localhost:6379 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.retry_attempts = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.retry_delay = 0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.socket_keepalive_count = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.socket_keepalive_idle = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.socket_keepalive_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.socket_timeout = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.tls_allowed_ciphers = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.tls_cafile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.tls_certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.tls_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.tls_keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cache.username = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] coordination.backend_url = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.asyncio_connection = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.asyncio_slave_connection = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.backend = sqlalchemy {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.connection = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.connection_debug = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.connection_parameters = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.connection_recycle_time = 3600 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.connection_trace = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.db_inc_retry_interval = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.db_max_retries = 20 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.db_max_retry_interval = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.db_retry_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.max_overflow = 50 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.max_pool_size = 5 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.max_retries = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.mysql_wsrep_sync_wait = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.pool_timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.retry_interval = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.slave_connection = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.sqlite_synchronous = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.synchronous_reader = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] database.use_db_reconnect = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.connection_string = messaging:// {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.es_doc_type = notification {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.es_scroll_size = 10000 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.es_scroll_time = 2m {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.filter_error_trace = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.hmac_keys = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.sentinel_service_name = mymaster {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.socket_timeout = 0.1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.trace_requests = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler.trace_sqlalchemy = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler_jaeger.process_tags = {} {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler_jaeger.service_name_prefix = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] profiler_otlp.service_name_prefix = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.enforce_new_defaults = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.enforce_scope = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.policy_default_rule = default {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.policy_file = policy.yaml {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.group = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.helper_command = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] privsep_osbrick.user = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.group = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.helper_command = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] cinder_sys_admin.user = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.auth_section = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.auth_type = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.cafile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.collect_timing = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.send_service_user_token = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] service_user.timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.auth_section = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.auth_type = password {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.collect_timing = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.region_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] glance.timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.backend_availability_zone = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.chap_password = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.chap_username = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.disk_geometry = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.driver_client_cert = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.driver_client_cert_key = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.driver_data_namespace = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.driver_use_ssl = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.extra_capabilities = {} {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.filter_function = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.goodness_function = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.iscsi_target_flags = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.iscsi_write_cache = on {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.iser_helper = tgtadm {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.iser_ip_address = 192.168.122.172 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.iser_port = 3260 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.lvm_share_target = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.lvm_type = auto {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.num_shell_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.replication_device = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.report_discard_supported = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.reserved_percentage = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.target_helper = tgtadm {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.target_ip_address = 192.168.122.172 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.target_port = 3260 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.target_protocol = iscsi {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.trace_flags = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.unique_fqdn_network = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.use_chap_auth = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_backend_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_clear = zero {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_clear_ionice = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_clear_size = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_reports.file_event_handler = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_reports.log_dir = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.backend_host = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.chap_password = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.chap_username = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.disk_geometry = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.driver_client_cert = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.extra_capabilities = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.filter_function = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.goodness_function = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.iser_helper = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.iser_ip_address = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.iser_port = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.lvm_share_target = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.lvm_type = auto {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.num_shell_tries = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.replication_device = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.report_discard_supported = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.reserved_percentage = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.scst_target_driver = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.storage_protocol = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.target_helper = lioadm {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.target_ip_address = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.target_port = 3260 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.trace_flags = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.use_chap_auth = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_clear = zero {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_clear_size = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] lvmdriver-1.volumes_dir = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_notifications.driver = [] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_notifications.retry = -1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] key_manager.fixed_key = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.barbican_api_version = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.barbican_endpoint = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.barbican_endpoint_type = public {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.barbican_region_name = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.cafile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.collect_timing = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:58 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.number_of_retries = 60 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.retry_delay = 1 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.send_service_user_token = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.verify_ssl = True {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican.verify_ssl_path = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.auth_section = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.auth_type = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.cafile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.certfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.collect_timing = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.insecure = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.keyfile = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.split_loggers = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] barbican_service_user.timeout = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.approle_role_id = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.approle_secret_id = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.kv_mountpoint = secret {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.kv_path = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.kv_version = 2 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.namespace = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.root_token_id = **** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.ssl_ca_crt_file = None {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.timeout = 60.0 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.use_ssl = False {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:19:59 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] ******************************************************************************** {{(pid=75080) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 15:19:59 devstack sudo[75258]: pam_unix(sudo:session): session closed for user root Jul 06 15:19:59 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.735s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:19:59 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:19:59 devstack sudo[75331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:19:59 devstack sudo[75331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:00 devstack sudo[75331]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.646s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:20:00 devstack cinder-volume[75254]: INFO cinder.brick.local_dev.lvm [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:00 devstack sudo[75580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:00 devstack sudo[75580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:00 devstack sudo[75580]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG cinder.brick.local_dev.lvm [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75254) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 15:20:00 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:00 devstack sudo[75826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:00 devstack sudo[75826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:02 devstack sudo[75826]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.275s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:02 devstack sudo[76007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:02 devstack sudo[76007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:02 devstack sudo[76007]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:02 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:02 devstack sudo[76040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 15:20:02 devstack sudo[76040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:03 devstack sudo[76040]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:03 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.683s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:03 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:03 devstack sudo[76044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:03 devstack sudo[76044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:04 devstack sudo[76044]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:04 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:04 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:04 devstack sudo[76054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:04 devstack sudo[76054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:05 devstack sudo[76054]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.740s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:05 devstack sudo[76059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:05 devstack sudo[76059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:05 devstack sudo[76059]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.831s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:06 devstack sudo[76070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:06 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:06 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.693s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:06 devstack sudo[76074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:06 devstack sudo[76074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:07 devstack sudo[76074]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:07 devstack cinder-volume[75254]: INFO cinder.volume.drivers.lvm [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 15:20:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:07 devstack sudo[76087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:07 devstack sudo[76087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:08 devstack sudo[76087]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:08 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:20:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:08 devstack sudo[76200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:08 devstack sudo[76200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:08 devstack cinder-volume[75080]: DEBUG dbcounter [-] [75080] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75080) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:20:08 devstack sudo[76200]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:08 devstack sudo[76341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:08 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:09 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:09 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:09 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:09 devstack sudo[76345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:09 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:10 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:10 devstack sudo[76348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:10 devstack sudo[76348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:10 devstack sudo[76348]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:10 devstack cinder-volume[75254]: INFO cinder.volume.driver [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Driver hasn't implemented _init_vendor_properties() Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG cinder.volume.driver [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75254) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG oslo_db.sqlalchemy.engines [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writer thread running {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG cinder.db.api [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Building query based on filter {{(pid=75254) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG cinder.image.image_utils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75254) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 15:20:10 devstack cinder-volume[75254]: INFO cinder.keymgr.migration [None req-5319423f-c04a-439a-aa14-cc121e726581 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:20:10 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:11 devstack sudo[76355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:11 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:11 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:11 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:11 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:11 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:11 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:12 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:12 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:12 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:12 devstack sudo[76364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:12 devstack sudo[76364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:12 devstack sudo[76364]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:12 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.704s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:12 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:12 devstack sudo[76368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:12 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:13 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:13 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:13 devstack cinder-volume[75254]: DEBUG cinder.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Notifying Schedulers of capabilities ... {{(pid=75254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:20:13 devstack cinder-volume[75254]: INFO cinder.volume.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Driver initialization completed successfully. Jul 06 15:20:13 devstack cinder-volume[75254]: INFO cinder.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Initiating service 2 cleanup Jul 06 15:20:13 devstack cinder-volume[75254]: INFO cinder.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Service 2 cleanup completed. Jul 06 15:20:13 devstack cinder-volume[75254]: DEBUG cinder.service [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Creating RPC server for service cinder-volume {{(pid=75254) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 15:20:13 devstack cinder-volume[75254]: DEBUG cinder.service [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75254) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 15:20:13 devstack cinder-volume[75254]: INFO cinder.volume.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 15:20:13 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:20:13 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:13 devstack sudo[76372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:20:13 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:14 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:14 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:14 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:14 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:14 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:15 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:15 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:15 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:15 devstack sudo[76435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:20:15 devstack sudo[76435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:15 devstack sudo[76435]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:15 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:15 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:20:15 devstack sudo[76438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:20:15 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:20:16 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root Jul 06 15:20:16 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:20:16 devstack cinder-volume[75254]: INFO cinder.volume.manager [None req-ff1531d2-7ad7-4c97-be27-6e51f673b02e None None] Driver post RPC initialization completed successfully. Jul 06 15:20:26 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writing DB stats cinder:SELECT=4 {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:20:26 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:21:05 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:21:05 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:21:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:05 devstack sudo[78093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:21:05 devstack sudo[78093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:06 devstack sudo[78093]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:06 devstack sudo[78096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:21:06 devstack sudo[78096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:06 devstack sudo[78096]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:06 devstack sudo[78099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:21:06 devstack sudo[78099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:07 devstack sudo[78099]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:21:07 devstack sudo[78102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:21:07 devstack sudo[78102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:21:08 devstack sudo[78102]: pam_unix(sudo:session): session closed for user root Jul 06 15:21:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:21:08 devstack cinder-volume[75254]: DEBUG cinder.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Notifying Schedulers of capabilities ... {{(pid=75254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:21:08 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager._thread_info {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:21:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread count: 6 {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:21:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread info: [<_MainThread(MainThread, started 125728112693376)>, , , , , ] {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:22:05 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:22:05 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:22:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:05 devstack sudo[81361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:22:05 devstack sudo[81361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:06 devstack sudo[81361]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:06 devstack sudo[81381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:22:06 devstack sudo[81381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:06 devstack sudo[81381]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:06 devstack sudo[81400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:22:06 devstack sudo[81400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:07 devstack sudo[81400]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:22:07 devstack sudo[81404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:22:07 devstack sudo[81404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:22:08 devstack sudo[81404]: pam_unix(sudo:session): session closed for user root Jul 06 15:22:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:22:08 devstack cinder-volume[75254]: DEBUG cinder.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Notifying Schedulers of capabilities ... {{(pid=75254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:22:08 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager._thread_info {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:22:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread count: 6 {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:22:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread info: [<_MainThread(MainThread, started 125728112693376)>, , , , , ] {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:22:26 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writing DB stats cinder:SELECT=1 {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:22:26 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writing DB stats cinder:UPDATE=1 {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:23:05 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:23:05 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:23:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:05 devstack sudo[83246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:23:05 devstack sudo[83246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:06 devstack sudo[83246]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:06 devstack sudo[83260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:23:06 devstack sudo[83260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:06 devstack sudo[83260]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:06 devstack sudo[83283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:23:06 devstack sudo[83283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:07 devstack sudo[83283]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:23:07 devstack sudo[83300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:23:07 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:23:08 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root Jul 06 15:23:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:23:08 devstack cinder-volume[75254]: DEBUG cinder.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Notifying Schedulers of capabilities ... {{(pid=75254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:23:08 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager._thread_info {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:23:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread count: 6 {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:23:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread info: [<_MainThread(MainThread, started 125728112693376)>, , , , , ] {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:24:05 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:24:05 devstack cinder-volume[75254]: DEBUG cinder.volume.drivers.lvm [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Updating volume stats {{(pid=75254) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 15:24:05 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:05 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 15:24:05 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:06 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:06 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:24:06 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:06 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:06 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:06 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 15:24:06 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:07 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.699s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:07 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:07 devstack sudo[84720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 15:24:07 devstack sudo[84720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:08 devstack sudo[84720]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:08 devstack cinder-volume[75254]: DEBUG oslo_concurrency.processutils [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:08 devstack cinder-volume[75254]: DEBUG cinder.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Notifying Schedulers of capabilities ... {{(pid=75254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:08 devstack cinder-volume[75254]: DEBUG oslo_service.periodic_task [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] Running periodic task VolumeManager._thread_info {{(pid=75254) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:24:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread count: 6 {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:24:08 devstack cinder-volume[75254]: DEBUG cinder.volume.manager [None req-6f47b92d-3cac-4ed7-96a2-212d3c35da3e None None] thread info: [<_MainThread(MainThread, started 125728112693376)>, , , , , ] {{(pid=75254) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:24:26 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writing DB stats cinder:SELECT=1 {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:26 devstack cinder-volume[75254]: DEBUG dbcounter [-] [75254] Writing DB stats cinder:UPDATE=1 {{(pid=75254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:33 devstack cinder-volume[75080]: INFO oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Caught SIGTERM, stopping children Jul 06 15:24:33 devstack cinder-volume[75080]: DEBUG oslo_concurrency.lockutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Acquiring lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:24:33 devstack cinder-volume[75080]: DEBUG oslo_concurrency.lockutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Acquired lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:24:33 devstack cinder-volume[75080]: DEBUG oslo_concurrency.lockutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Releasing lock "singleton_lock" {{(pid=75080) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:24:33 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Stop services. {{(pid=75080) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 15:24:33 devstack cinder-volume[75080]: DEBUG oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Killing children. {{(pid=75080) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 15:24:33 devstack cinder-volume[75080]: INFO oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Waiting on 1 children to exit Jul 06 15:24:33 devstack cinder-volume[75254]: DEBUG oslo_concurrency.lockutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Acquiring lock "singleton_lock" {{(pid=75254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:24:33 devstack cinder-volume[75254]: DEBUG oslo_concurrency.lockutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Acquired lock "singleton_lock" {{(pid=75254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:24:33 devstack cinder-volume[75254]: DEBUG oslo_concurrency.lockutils [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Releasing lock "singleton_lock" {{(pid=75254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:24:33 devstack cinder-volume[75254]: WARNING amqp [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:24:33 devstack cinder-volume[75254]: WARNING amqp [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:24:33 devstack cinder-volume[75080]: INFO oslo_service.backend._eventlet.service [None req-bd5f9c63-bceb-4324-9b6e-dd8d2add052a None None] Child 75254 exited with status 0 Jul 06 15:24:34 devstack cinder-volume[85374]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 15:24:34 devstack cinder-volume[85374]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:24:34 devstack cinder-volume[85374]: we strongly recommend against using it for new projects. Jul 06 15:24:34 devstack cinder-volume[85374]: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:24:34 devstack cinder-volume[85374]: framework. For more detail see Jul 06 15:24:34 devstack cinder-volume[85374]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:24:34 devstack cinder-volume[85374]: import eventlet # noqa Jul 06 15:24:36 devstack cinder-volume[85374]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:24:36 devstack cinder-volume[85374]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:24:36 devstack cinder-volume[85374]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:24:36 devstack cinder-volume[85374]: INFO dbcounter [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Registered counter for database cinder Jul 06 15:24:36 devstack cinder-volume[85374]: DEBUG oslo_db.sqlalchemy.engines [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG dbcounter [-] [85374] Writer thread running {{(pid=85374) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:24:37 devstack cinder-volume[85374]: INFO cinder.rpc [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 15:24:37 devstack cinder-volume[85374]: INFO cinder.rpc [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_db.sqlalchemy.engines [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:37 devstack cinder-volume[85374]: INFO cinder.volume.manager [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Determined volume DB was empty at startup. Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG cinder.volume.manager [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85374) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 15:24:37 devstack cinder-volume[85374]: INFO cinder.volume.manager [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 15:24:37 devstack cinder-volume[85374]: WARNING stevedore.named [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:24:37 devstack cinder-volume[85374]: WARNING castellan.key_manager [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:24:37 devstack cinder-volume[85374]: WARNING cinder.keymgr.conf_key_mgr [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:24:37 devstack cinder-volume[85374]: INFO cinder.volume.manager [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_db.sqlalchemy.engines [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85374) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:37 devstack cinder-volume[85374]: INFO oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Starting 1 workers Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Started child 85590 {{(pid=85374) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Full set of CONF: {{(pid=85374) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] ******************************************************************************** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Configuration options gathered from: {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] ================================================================================ {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] allow_availability_zone_fallback = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] allow_compression_on_image_upload = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] allowed_direct_url_schemes = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] api_rate_limit = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] auth_strategy = keystone {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_availability_zone = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_host = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_stats_polling_interval = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backup_api_class = cinder.backup.api.API {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backup_name_template = backup-%s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85590]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backup_use_same_host = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backup_use_temp_snapshot = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] chap_password = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] chap_username = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_internal_tenant_project_id = 334a496138a344cbbc6c1b2d0921b60b {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_internal_tenant_user_id = cc70021d8a544db38d47cd341a0ad051 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cluster = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] compression_format = gzip {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] compute_api_class = cinder.compute.nova.API {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] config_dir = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] config_source = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] control_exchange = openstack {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] debug = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] default_availability_zone = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] default_group_type = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] default_volume_type = QuobyteHD {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] disk_geometry = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] driver_client_cert = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] driver_client_cert_key = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] driver_data_namespace = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] driver_ssl_cert_path = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] driver_ssl_cert_verify = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] driver_use_ssl = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] enable_new_services = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] enable_unsupported_driver = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] enabled_backends = ['QuobyteHD'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] enforce_multipath_for_image_xfer = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] filter_function = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_api_insecure = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_api_servers = ['http://192.168.122.172/image'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_api_ssl_compression = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_ca_certificates_file = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_catalog_info = image:glance:publicURL {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_num_retries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance_request_timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] goodness_function = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] graceful_shutdown_timeout = 5 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] group_api_class = cinder.group.api.API {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] host = devstack {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_compress_on_upload = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_conversion_address_space_limit = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_conversion_cpu_limit = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_conversion_disable = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_upload_use_cinder_backend = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_upload_use_internal_tenant = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_volume_cache_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_volume_cache_max_count = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] image_volume_cache_max_size_gb = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] init_host_max_objects_retrieval = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] instance_format = [instance: %(uuid)s] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] iscsi_target_flags = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] iscsi_write_cache = on {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] iser_helper = tgtadm {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] iser_ip_address = 192.168.122.172 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] iser_port = 3260 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_color = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_config_append = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_dir = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_file = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_options = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_rotate_interval = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_rotate_interval_type = days {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] log_rotation_type = none {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] max_age = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] max_logfile_count = 30 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] max_logfile_size_mb = 200 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] max_over_subscription_ratio = 20.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] message_reap_interval = 86400 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] message_ttl = 2592000 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] migration_create_volume_timeout_secs = 300 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] monkey_patch = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] monkey_patch_modules = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] my_ip = 192.168.122.172 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] no_snapshot_gb_quota = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] num_iser_scan_tries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] num_shell_tries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] num_volume_device_scan_tries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] nvmeof_conn_info_version = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] nvmet_ns_id = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] nvmet_port_id = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_max_limit = 1000 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_volume_ext_list = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_volume_listen_port = 8776 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_volume_use_ssl = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] osapi_volume_workers = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] per_volume_size_limit = -1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] periodic_fuzzy_delay = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] periodic_interval = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] public_endpoint = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] publish_errors = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_backup_gigabytes = 1000 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_backups = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_gigabytes = 1000 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_groups = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_snapshots = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] quota_volumes = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] rate_limit_burst = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] rate_limit_except_level = CRITICAL {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] rate_limit_interval = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] reinit_driver_count = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] replication_device = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] report_discard_supported = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] report_interval = 120 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] reservation_clean_interval = 86400 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] reservation_expire = 86400 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] reserved_image_namespaces = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] reserved_percentage = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] rpc_response_timeout = 120 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] run_external_periodic_tasks = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] scst_target_driver = iscsi {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] scst_target_iqn_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_down_time = 720 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] shell_completion = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] snapshot_name_template = snapshot-%s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] split_loggers = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] state_path = /opt/stack/data/cinder {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] storage_availability_zone = nova {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] storage_protocol = iSCSI {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] syslog_log_facility = LOG_USER {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] target_helper = lioadm {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] target_ip_address = 192.168.122.172 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] target_port = 3260 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] target_protocol = iscsi {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] target_secondary_ip_addresses = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] trace_flags = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] transport_url = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] until_refresh = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_chap_auth = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_default_quota_class = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_journal = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_json = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_multipath_for_image_xfer = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_stderr = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] use_syslog = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] verify_glance_signatures = enabled {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_api_class = cinder.volume.api.API {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_backend_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_clear = zero {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_clear_ionice = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_clear_size = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_copy_bps_limit = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_dd_blocksize = 1M {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_name_template = volume-%s {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_service_inithost_offload = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volume_usage_audit_period = month {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] zoning_mode = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_concurrency.disable_process_locking = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.auth_section = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.auth_type = password {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.auth_version = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.cache = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.include_service_catalog = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.insecure = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.interface = public {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_password = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcache_username = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.region_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.service_type = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.172/identity {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.backend = dogpile.cache.null {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.backend_argument = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.backend_expiration_time = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.config_prefix = cache.oslo {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.debug_cache_backend = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.enable_retry_client = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.enable_socket_keepalive = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.expiration_time = 600 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.hashclient_retry_attempts = 2 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_dead_retry = 300 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_pool_maxsize = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_sasl_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.password = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.proxies = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.redis_db = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.redis_server = localhost:6379 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.retry_attempts = 2 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.retry_delay = 0.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: INFO cinder.volume.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.socket_keepalive_count = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.remotefs [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85590) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.socket_keepalive_idle = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.socket_keepalive_interval = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.socket_timeout = 1.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.tls_allowed_ciphers = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.tls_cafile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.tls_certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.tls_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.tls_keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cache.username = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] coordination.backend_url = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.asyncio_connection = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.asyncio_slave_connection = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.backend = sqlalchemy {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.connection = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.connection_debug = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.connection_parameters = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.connection_recycle_time = 3600 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.connection_trace = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.db_inc_retry_interval = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.db_max_retries = 20 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.db_max_retry_interval = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.db_retry_interval = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.max_overflow = 50 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.max_pool_size = 5 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.max_retries = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.mysql_wsrep_sync_wait = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.pool_timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.retry_interval = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.slave_connection = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.sqlite_synchronous = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.synchronous_reader = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] database.use_db_reconnect = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.connection_string = messaging:// {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.es_doc_type = notification {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.es_scroll_size = 10000 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.es_scroll_time = 2m {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.filter_error_trace = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.hmac_keys = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.sentinel_service_name = mymaster {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.socket_timeout = 0.1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.trace_requests = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler.trace_sqlalchemy = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler_jaeger.process_tags = {} {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler_jaeger.service_name_prefix = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] profiler_otlp.service_name_prefix = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.enforce_new_defaults = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.enforce_scope = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.policy_default_rule = default {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.policy_file = policy.yaml {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.group = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.helper_command = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] privsep_osbrick.user = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.group = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.helper_command = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] cinder_sys_admin.user = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.auth_section = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.auth_type = password {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.cafile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.collect_timing = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.insecure = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.send_service_user_token = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.split_loggers = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] service_user.timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.auth_section = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.auth_type = password {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.collect_timing = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.insecure = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.region_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.split_loggers = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] glance.timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.backend_availability_zone = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.chap_password = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.chap_username = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.disk_geometry = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.driver_client_cert = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.driver_client_cert_key = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.driver_data_namespace = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.driver_use_ssl = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.extra_capabilities = {} {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.filter_function = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.goodness_function = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.iscsi_target_flags = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.iscsi_write_cache = on {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.iser_helper = tgtadm {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.iser_ip_address = 192.168.122.172 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.iser_port = 3260 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_host = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_login = admin {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_mount_options = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_password = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_private_key = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_share_path = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.num_shell_tries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.quobyte_volume_url = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.replication_device = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.report_discard_supported = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.reserved_percentage = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.target_helper = tgtadm {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.target_ip_address = 192.168.122.172 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.target_port = 3260 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.target_protocol = iscsi {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.trace_flags = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.unique_fqdn_network = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.use_chap_auth = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_backend_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_clear = zero {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_clear_ionice = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_clear_size = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_reports.file_event_handler = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_reports.log_dir = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.backend_availability_zone = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.backend_host = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.chap_password = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.chap_username = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.chiscsi_conf = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.disk_geometry = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.driver_client_cert = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85590) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 15:24:37 devstack cinder-volume[85590]: WARNING cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 15:24:37 devstack cinder-volume[85590]: WARNING cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.driver_data_namespace = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.driver_use_ssl = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.extra_capabilities = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Running cmd (subprocess): mount.quobyte {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.filter_function = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.goodness_function = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.iser_helper = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.iser_ip_address = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.iser_port = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.iser_target_prefix = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_host = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_login = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_mount_options = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_password = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_private_key = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_share_path = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_ssh_port = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.num_shell_tries = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.nvmet_port_id = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.replication_device = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.report_discard_supported = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.reserved_percentage = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.scst_target_driver = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.storage_protocol = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.target_helper = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.target_ip_address = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.target_port = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.target_prefix = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.target_protocol = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.trace_flags = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.use_chap_auth = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_clear = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_clear_size = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] QuobyteHD.volumes_dir = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_notifications.driver = [] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_notifications.retry = -1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] key_manager.fixed_key = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.barbican_api_version = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.barbican_endpoint = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack quobyte-client[85595]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 15:24:37 devstack quobyte-client[85595]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.barbican_endpoint_type = public {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.barbican_region_name = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.cafile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.collect_timing = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.insecure = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=85590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.number_of_retries = 60 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.retry_delay = 1 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.send_service_user_token = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.split_loggers = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85590]: INFO cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f ... Jul 06 15:24:37 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f -c /etc/quobyte/client-cinder.cfg {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.verify_ssl = True {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican.verify_ssl_path = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.auth_section = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.auth_type = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.cafile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.certfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.collect_timing = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:37 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.insecure = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.keyfile = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.split_loggers = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] barbican_service_user.timeout = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.approle_role_id = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.approle_secret_id = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.kv_mountpoint = secret {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.kv_path = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.kv_version = 2 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.namespace = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.root_token_id = **** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.ssl_ca_crt_file = None {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.timeout = 60.0 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.use_ssl = False {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:38 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] ******************************************************************************** {{(pid=85374) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 15:24:38 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f -c /etc/quobyte/client-cinder.cfg Jul 06 15:24:38 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:38 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:38 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.744s {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:38 devstack cinder-volume[85590]: INFO cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f succeeded Jul 06 15:24:38 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=85590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:38 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.757s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:38 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:38 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:38 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:39 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.682s {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:39 devstack cinder-volume[85590]: INFO cinder.volume.driver [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Driver hasn't implemented _init_vendor_properties() Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG cinder.volume.driver [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85590) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG oslo_db.sqlalchemy.engines [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85590) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG dbcounter [-] [85590] Writer thread running {{(pid=85590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG cinder.db.api [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Building query based on filter {{(pid=85590) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG cinder.image.image_utils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85590) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 15:24:39 devstack cinder-volume[85590]: INFO cinder.keymgr.migration [None req-1a542f07-14a9-46f1-9d97-fffe738c2851 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=85590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=85590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:39 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:39 devstack sudo[85671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:39 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:40 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.655s {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG cinder.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Notifying Schedulers of capabilities ... {{(pid=85590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:40 devstack cinder-volume[85590]: INFO cinder.volume.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Driver initialization completed successfully. Jul 06 15:24:40 devstack cinder-volume[85590]: INFO cinder.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Initiating service 3 cleanup Jul 06 15:24:40 devstack cinder-volume[85590]: INFO cinder.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Service 3 cleanup completed. Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG cinder.service [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Creating RPC server for service cinder-volume {{(pid=85590) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG cinder.service [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85590) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 15:24:40 devstack cinder-volume[85590]: INFO cinder.volume.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=85590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=85590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:40 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:40 devstack sudo[85678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:40 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:41 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:41 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.672s {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:41 devstack cinder-volume[85590]: INFO cinder.volume.manager [None req-5fd0b483-e406-4507-ada3-8da19692c60d None None] Driver post RPC initialization completed successfully. Jul 06 15:24:44 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:44 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:44 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=85590) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:44 devstack cinder-volume[85590]: DEBUG cinder.volume.drivers.quobyte [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=85590) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:44 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85590) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:44 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:44 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:45 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:45 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:45 devstack cinder-volume[85590]: DEBUG oslo_concurrency.processutils [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.577s {{(pid=85590) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:45 devstack cinder-volume[85590]: DEBUG cinder.manager [None req-037a44f9-7b87-45af-80d2-dcacbcd9c0c9 None None] Notifying Schedulers of capabilities ... {{(pid=85590) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:47 devstack cinder-volume[85374]: INFO oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Caught SIGTERM, stopping children Jul 06 15:24:47 devstack cinder-volume[85374]: DEBUG oslo_concurrency.lockutils [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Acquiring lock "singleton_lock" {{(pid=85374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:24:47 devstack cinder-volume[85374]: DEBUG oslo_concurrency.lockutils [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Acquired lock "singleton_lock" {{(pid=85374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:24:47 devstack cinder-volume[85374]: DEBUG oslo_concurrency.lockutils [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Releasing lock "singleton_lock" {{(pid=85374) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:24:47 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Stop services. {{(pid=85374) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 15:24:47 devstack cinder-volume[85374]: DEBUG oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Killing children. {{(pid=85374) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 15:24:47 devstack cinder-volume[85374]: INFO oslo_service.backend._eventlet.service [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Waiting on 1 children to exit Jul 06 15:24:51 devstack cinder-volume[85590]: DEBUG dbcounter [-] [85590] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:51 devstack cinder-volume[85590]: DEBUG dbcounter [-] [85590] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=85590) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:24:52 devstack cinder-volume[85590]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 06 15:24:52 devstack cinder-volume[85891]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 15:24:52 devstack cinder-volume[85891]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:24:52 devstack cinder-volume[85891]: we strongly recommend against using it for new projects. Jul 06 15:24:52 devstack cinder-volume[85891]: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:24:52 devstack cinder-volume[85891]: framework. For more detail see Jul 06 15:24:52 devstack cinder-volume[85891]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:24:52 devstack cinder-volume[85891]: import eventlet # noqa Jul 06 15:24:53 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Acquiring lock "singleton_lock" {{(pid=85590) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:24:53 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Acquired lock "singleton_lock" {{(pid=85590) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:24:53 devstack cinder-volume[85590]: DEBUG oslo_concurrency.lockutils [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Releasing lock "singleton_lock" {{(pid=85590) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:24:53 devstack cinder-volume[85590]: WARNING amqp [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:24:53 devstack cinder-volume[85590]: WARNING amqp [None req-ba981232-c3a9-461c-b96a-992ea0261123 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 15:24:55 devstack cinder-volume[85891]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 15:24:55 devstack cinder-volume[85891]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 15:24:55 devstack cinder-volume[85891]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 15:24:55 devstack cinder-volume[85891]: INFO dbcounter [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Registered counter for database cinder Jul 06 15:24:55 devstack cinder-volume[85891]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG dbcounter [-] [85891] Writer thread running {{(pid=85891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:24:56 devstack cinder-volume[85891]: INFO cinder.rpc [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 15:24:56 devstack cinder-volume[85891]: INFO cinder.rpc [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:56 devstack cinder-volume[85891]: INFO cinder.volume.manager [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Determined volume DB was empty at startup. Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG cinder.volume.manager [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85891) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 15:24:56 devstack cinder-volume[85891]: WARNING stevedore.named [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 15:24:56 devstack cinder-volume[85891]: WARNING castellan.key_manager [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:24:56 devstack cinder-volume[85891]: WARNING cinder.keymgr.conf_key_mgr [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 15:24:56 devstack cinder-volume[85891]: INFO cinder.volume.manager [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_db.sqlalchemy.engines [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:56 devstack cinder-volume[85891]: INFO oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Starting 1 workers Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Started child 86191 {{(pid=85891) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Full set of CONF: {{(pid=85891) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] ******************************************************************************** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] Configuration options gathered from: {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] ================================================================================ {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 15:24:56 devstack cinder-volume[86191]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] allow_availability_zone_fallback = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] allow_compression_on_image_upload = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] allowed_direct_url_schemes = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] api_rate_limit = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] auth_strategy = keystone {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_availability_zone = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_host = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_stats_polling_interval = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backup_api_class = cinder.backup.api.API {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backup_name_template = backup-%s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backup_use_same_host = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backup_use_temp_snapshot = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] chap_password = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] chap_username = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_internal_tenant_project_id = 334a496138a344cbbc6c1b2d0921b60b {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_internal_tenant_user_id = cc70021d8a544db38d47cd341a0ad051 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cluster = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] compression_format = gzip {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] compute_api_class = cinder.compute.nova.API {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] config_dir = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] config_source = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] control_exchange = openstack {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] debug = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] default_availability_zone = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] default_group_type = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] default_volume_type = QuobyteHD {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] disk_geometry = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] driver_client_cert = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] driver_client_cert_key = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] driver_data_namespace = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] driver_ssl_cert_path = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] driver_ssl_cert_verify = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] driver_use_ssl = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] enable_new_services = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] enable_unsupported_driver = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] enabled_backends = ['QuobyteHD'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] enforce_multipath_for_image_xfer = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] filter_function = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_api_insecure = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_api_servers = ['http://192.168.122.172/image'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_api_ssl_compression = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_ca_certificates_file = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_catalog_info = image:glance:publicURL {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_num_retries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance_request_timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] goodness_function = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] graceful_shutdown_timeout = 5 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] group_api_class = cinder.group.api.API {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] host = devstack {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_compress_on_upload = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_conversion_address_space_limit = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_conversion_cpu_limit = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_conversion_disable = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_upload_use_cinder_backend = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_upload_use_internal_tenant = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_volume_cache_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_volume_cache_max_count = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] image_volume_cache_max_size_gb = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] init_host_max_objects_retrieval = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] instance_format = [instance: %(uuid)s] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] iscsi_target_flags = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] iscsi_write_cache = on {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] iser_helper = tgtadm {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] iser_ip_address = 192.168.122.172 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] iser_port = 3260 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_color = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_config_append = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_dir = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_file = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_options = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_rotate_interval = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_rotate_interval_type = days {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] log_rotation_type = none {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] max_age = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] max_logfile_count = 30 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] max_logfile_size_mb = 200 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86191) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] max_over_subscription_ratio = 20.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] message_reap_interval = 86400 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] message_ttl = 2592000 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] migration_create_volume_timeout_secs = 300 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] monkey_patch = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] monkey_patch_modules = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] my_ip = 192.168.122.172 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] no_snapshot_gb_quota = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] num_iser_scan_tries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] num_shell_tries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] num_volume_device_scan_tries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] nvmeof_conn_info_version = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] nvmet_ns_id = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] nvmet_port_id = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_max_limit = 1000 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_volume_ext_list = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_volume_listen_port = 8776 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_volume_use_ssl = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] osapi_volume_workers = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] per_volume_size_limit = -1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] periodic_fuzzy_delay = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] periodic_interval = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] public_endpoint = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] publish_errors = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_backup_gigabytes = 1000 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_backups = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_gigabytes = 1000 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_groups = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_snapshots = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] quota_volumes = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] rate_limit_burst = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] rate_limit_except_level = CRITICAL {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] rate_limit_interval = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] reinit_driver_count = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] replication_device = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] report_discard_supported = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] report_interval = 120 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] reservation_clean_interval = 86400 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] reservation_expire = 86400 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] reserved_image_namespaces = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] reserved_percentage = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] rpc_response_timeout = 120 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] run_external_periodic_tasks = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] scst_target_driver = iscsi {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] scst_target_iqn_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_down_time = 720 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] shell_completion = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] snapshot_name_template = snapshot-%s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] split_loggers = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] state_path = /opt/stack/data/cinder {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] storage_availability_zone = nova {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] storage_protocol = iSCSI {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] syslog_log_facility = LOG_USER {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] target_helper = lioadm {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] target_ip_address = 192.168.122.172 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] target_port = 3260 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] target_protocol = iscsi {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] target_secondary_ip_addresses = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] trace_flags = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] transport_url = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] until_refresh = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_chap_auth = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_default_quota_class = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_journal = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_json = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_multipath_for_image_xfer = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_stderr = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] use_syslog = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] verify_glance_signatures = enabled {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_api_class = cinder.volume.api.API {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_backend_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_clear = zero {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_clear_ionice = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_clear_size = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_copy_bps_limit = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_dd_blocksize = 1M {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_name_template = volume-%s {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_service_inithost_offload = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volume_usage_audit_period = month {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] zoning_mode = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_concurrency.disable_process_locking = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.auth_section = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.auth_type = password {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.auth_version = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.cache = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.include_service_catalog = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.insecure = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.interface = public {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_password = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcache_username = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.region_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86191) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 15:24:56 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.service_type = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.172/identity {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.backend = dogpile.cache.null {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Running cmd (subprocess): mount.quobyte {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.backend_argument = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.backend_expiration_time = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.config_prefix = cache.oslo {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.debug_cache_backend = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.enable_retry_client = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.enable_socket_keepalive = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.expiration_time = 600 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.hashclient_retry_attempts = 2 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_dead_retry = 300 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_pool_maxsize = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_sasl_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.password = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.proxies = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.redis_db = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.redis_server = localhost:6379 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.retry_attempts = 2 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.retry_delay = 0.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.socket_keepalive_count = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.socket_keepalive_idle = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.socket_keepalive_interval = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.socket_timeout = 1.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.tls_allowed_ciphers = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.tls_cafile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.tls_certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.tls_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.tls_keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cache.username = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] coordination.backend_url = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.asyncio_connection = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.asyncio_slave_connection = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.backend = sqlalchemy {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.connection = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.connection_debug = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.connection_parameters = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.connection_recycle_time = 3600 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.connection_trace = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.db_inc_retry_interval = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.db_max_retries = 20 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.db_max_retry_interval = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.db_retry_interval = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.max_overflow = 50 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.max_pool_size = 5 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.max_retries = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.mysql_wsrep_sync_wait = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.pool_timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.retry_interval = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.slave_connection = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.sqlite_synchronous = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.synchronous_reader = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] database.use_db_reconnect = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.connection_string = messaging:// {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.es_doc_type = notification {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.es_scroll_size = 10000 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.es_scroll_time = 2m {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.filter_error_trace = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.hmac_keys = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.sentinel_service_name = mymaster {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.socket_timeout = 0.1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.trace_requests = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler.trace_sqlalchemy = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler_jaeger.process_tags = {} {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler_jaeger.service_name_prefix = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] profiler_otlp.service_name_prefix = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.enforce_new_defaults = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.enforce_scope = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.policy_default_rule = default {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.policy_file = policy.yaml {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.group = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.helper_command = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] privsep_osbrick.user = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.group = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.helper_command = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] cinder_sys_admin.user = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.auth_section = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.auth_type = password {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.cafile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.collect_timing = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.insecure = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.send_service_user_token = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.split_loggers = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] service_user.timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.auth_section = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.auth_type = password {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.collect_timing = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.insecure = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.region_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.split_loggers = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] glance.timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.backend_availability_zone = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.chap_password = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.chap_username = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.disk_geometry = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.driver_client_cert = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.driver_client_cert_key = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.driver_data_namespace = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.driver_use_ssl = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack quobyte-client[86203]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.extra_capabilities = {} {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.filter_function = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.goodness_function = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack quobyte-client[86203]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.iscsi_target_flags = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.iscsi_write_cache = on {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.iser_helper = tgtadm {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.iser_ip_address = 192.168.122.172 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.iser_port = 3260 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_host = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_login = admin {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_mount_options = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_password = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_private_key = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_share_path = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.num_shell_tries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.quobyte_volume_url = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.replication_device = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.report_discard_supported = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.reserved_percentage = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.target_helper = tgtadm {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.target_ip_address = 192.168.122.172 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.target_port = 3260 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.target_protocol = iscsi {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.trace_flags = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.unique_fqdn_network = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.use_chap_auth = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_backend_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_clear = zero {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_clear_ionice = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_clear_size = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_reports.file_event_handler = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_reports.log_dir = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.backend_availability_zone = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.backend_host = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.chap_password = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.chap_username = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.chiscsi_conf = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.disk_geometry = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.driver_client_cert = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.driver_data_namespace = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.driver_use_ssl = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.extra_capabilities = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.filter_function = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.goodness_function = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.iser_helper = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.iser_ip_address = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.iser_port = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.iser_target_prefix = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_host = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_login = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_mount_options = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_password = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_private_key = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_share_path = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_ssh_port = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.num_shell_tries = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.nvmet_port_id = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.replication_device = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.report_discard_supported = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.reserved_percentage = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.scst_target_driver = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.storage_protocol = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.target_helper = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.target_ip_address = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.target_port = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.target_prefix = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.target_protocol = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.trace_flags = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.use_chap_auth = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_clear = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_clear_size = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] QuobyteHD.volumes_dir = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_notifications.driver = [] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_notifications.retry = -1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] key_manager.fixed_key = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.barbican_api_version = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.barbican_endpoint = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.barbican_endpoint_type = public {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.barbican_region_name = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.cafile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.collect_timing = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.insecure = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.number_of_retries = 60 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.retry_delay = 1 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.send_service_user_token = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.split_loggers = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.verify_ssl = True {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican.verify_ssl_path = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.auth_section = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.auth_type = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.cafile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.certfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.collect_timing = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.insecure = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.keyfile = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.split_loggers = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] barbican_service_user.timeout = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.approle_role_id = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.approle_secret_id = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.kv_mountpoint = secret {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.kv_path = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.kv_version = 2 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.namespace = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.root_token_id = **** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.ssl_ca_crt_file = None {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.timeout = 60.0 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.use_ssl = False {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 15:24:56 devstack cinder-volume[85891]: DEBUG oslo_service.backend._eventlet.service [None req-1f6fbf2b-ca80-43c8-a87b-596263a605f4 None None] ******************************************************************************** {{(pid=85891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 15:24:57 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.693s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:57 devstack cinder-volume[86191]: INFO cinder.volume.driver [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Driver hasn't implemented _init_vendor_properties() Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG cinder.volume.driver [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755241394043, 'free_capacity_gb': 1775.755241394043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86191) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_db.sqlalchemy.engines [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86191) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writer thread running {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG cinder.db.api [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Building query based on filter {{(pid=86191) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86191) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:57 devstack cinder-volume[86191]: INFO cinder.keymgr.migration [None req-e064d82c-946b-474f-878a-bc712d707ca3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 15:24:57 devstack sudo[86223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:57 devstack sudo[86223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:57 devstack sudo[86223]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.618s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:57 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:24:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Driver initialization completed successfully. Jul 06 15:24:57 devstack cinder-volume[86191]: INFO cinder.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Initiating service 3 cleanup Jul 06 15:24:58 devstack cinder-volume[86191]: INFO cinder.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Service 3 cleanup completed. Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG cinder.service [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Creating RPC server for service cinder-volume {{(pid=86191) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG cinder.service [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86191) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 15:24:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:24:58 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:24:58 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:24:58 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Jul 06 15:24:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.657s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:24:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-93b8a15e-d0d5-4604-bb42-8b5a836a36db None None] Driver post RPC initialization completed successfully. Jul 06 15:25:06 devstack cinder-volume[85891]: DEBUG dbcounter [-] [85891] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:25:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:25:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 6 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:25:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:25:07 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:25:08 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=3 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Flow 'volume_create_manager' (91b848f4-ed05-4f0d-afe8-4767f518906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20734e0f-244d-4ad9-ae56-d3599fe36e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20734e0f-244d-4ad9-ae56-d3599fe36e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1499384033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46badea9-fe8d-4449-b369-c77f0e90b1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b7fa9c77dd45cf917e2ed74135a3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:54Z,use_quota=True,user_id='0adb529e604946b598baa78f134372d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417714a5-f548-4e35-9e16-265c84e5e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417714a5-f548-4e35-9e16-265c84e5e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364b17ef-eedb-443e-94ad-9463760c0b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364b17ef-eedb-443e-94ad-9463760c0b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46badea9-fe8d-4449-b369-c77f0e90b1b2', 'volume_name': 'volume-46badea9-fe8d-4449-b369-c77f0e90b1b2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22c1719-0a4e-481d-8272-99b98cd70af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22c1719-0a4e-481d-8272-99b98cd70af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6498b9-123c-481c-839a-99ff5b81e9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:53 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Volume 46badea9-fe8d-4449-b369-c77f0e90b1b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46badea9-fe8d-4449-b369-c77f0e90b1b2', 'volume_size': 1} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1499384033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46badea9-fe8d-4449-b369-c77f0e90b1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b7fa9c77dd45cf917e2ed74135a3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:25:54Z,use_quota=True,user_id='0adb529e604946b598baa78f134372d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Creating volume 46badea9-fe8d-4449-b369-c77f0e90b1b2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:25:53 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:25:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:54 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 1073741824 Jul 06 15:25:54 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:55 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 1073741824" returned: 0 in 1.096s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:25:55 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 Jul 06 15:25:55 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:25:55 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6498b9-123c-481c-839a-99ff5b81e9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46badea9-fe8d-4449-b369-c77f0e90b1b2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2956ad3d-b1d9-4ad4-abb8-155534a2e1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:25:55 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Volume volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 (46badea9-fe8d-4449-b369-c77f0e90b1b2): created successfully Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2956ad3d-b1d9-4ad4-abb8-155534a2e1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:25:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Flow 'volume_create_manager' (91b848f4-ed05-4f0d-afe8-4767f518906d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:25:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-eca84241-8474-41f4-8e4f-221d7715fc15 tempest-TaggedAttachmentsTest-737532430 None] Created volume successfully. Jul 06 15:26:05 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:06 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:26:06 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:07 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.826s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:26:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:26:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 6 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:26:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Flow 'volume_create_manager' (8400312a-2d65-4f28-9731-6d83bd6182a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c8e46-d04c-40ca-af79-76fffec6035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44c8e46-d04c-40ca-af79-76fffec6035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2083407140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c8f814-47cd-4630-9791-4a8dc88666cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab90bfad4e384395aac9df2b92181251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:41Z,use_quota=True,user_id='74a91ef4ad6d4b4aa2901bb65b9b85df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091a250e-5f87-4203-9acc-dcd6c3edeed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091a250e-5f87-4203-9acc-dcd6c3edeed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde3ae69-cae2-4b99-90c2-7c8354c039d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde3ae69-cae2-4b99-90c2-7c8354c039d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c8f814-47cd-4630-9791-4a8dc88666cb', 'volume_name': 'volume-58c8f814-47cd-4630-9791-4a8dc88666cb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2f6173-d8e8-4b96-8570-e1247fd03763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2f6173-d8e8-4b96-8570-e1247fd03763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ef5c03-7d19-4ba4-9bb5-10894eecdcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:41 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Volume 58c8f814-47cd-4630-9791-4a8dc88666cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c8f814-47cd-4630-9791-4a8dc88666cb', 'volume_size': 1} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2083407140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c8f814-47cd-4630-9791-4a8dc88666cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab90bfad4e384395aac9df2b92181251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:41Z,use_quota=True,user_id='74a91ef4ad6d4b4aa2901bb65b9b85df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Creating volume 58c8f814-47cd-4630-9791-4a8dc88666cb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:26:41 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:26:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:41 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb 1073741824 Jul 06 15:26:41 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:43 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb 1073741824" returned: 0 in 1.626s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:43 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb Jul 06 15:26:43 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:44 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb" returned: 0 in 1.261s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] <== create_volume: return (2974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.982s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ef5c03-7d19-4ba4-9bb5-10894eecdcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c8f814-47cd-4630-9791-4a8dc88666cb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4071590c-0d8b-44ca-9cc1-0f70e5ce3a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Volume volume-58c8f814-47cd-4630-9791-4a8dc88666cb (58c8f814-47cd-4630-9791-4a8dc88666cb): created successfully Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4071590c-0d8b-44ca-9cc1-0f70e5ce3a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Flow 'volume_create_manager' (8400312a-2d65-4f28-9731-6d83bd6182a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7447a06a-cc98-4c3a-aa5e-dc776070d279 tempest-VolumesAdminNegativeTest-1040613447 None] Created volume successfully. Jul 06 15:26:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Acquiring lock "cinder-58c8f814-47cd-4630-9791-4a8dc88666cb-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "cinder-58c8f814-47cd-4630-9791-4a8dc88666cb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Acquiring lock "cinder-quobyte-58c8f814-47cd-4630-9791-4a8dc88666cb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:26:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "cinder-quobyte-58c8f814-47cd-4630-9791-4a8dc88666cb" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:26:46 devstack cinder-volume[86191]: INFO oslo.privsep.daemon [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpk86zj4bf/privsep.sock'] Jul 06 15:26:46 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpk86zj4bf/privsep.sock Jul 06 15:26:46 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:26:47 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 15:26:48 devstack cinder-volume[86191]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 15:26:49 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:49 devstack cinder-volume[86191]: INFO oslo.privsep.daemon [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Spawned new privsep daemon via rootwrap Jul 06 15:26:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Accepted privsep connection to /tmp/tmpk86zj4bf/privsep.sock {{(pid=86191) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 15:26:49 devstack cinder-volume[86191]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 15:26:49 devstack cinder-volume[86191]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 15:26:49 devstack cinder-volume[86191]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 15:26:49 devstack cinder-volume[86191]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87789 Jul 06 15:26:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad0c42d-1f23-453c-98ef-09b2debd09b6]: (2,) {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c959592-b31c-49ac-8c77-4ad6800262bd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:26:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:49 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb Jul 06 15:26:49 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:49 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb" returned: 0 in 0.839s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:49 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb Jul 06 15:26:49 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:50 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-58c8f814-47cd-4630-9791-4a8dc88666cb" returned: 0 in 0.659s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "cinder-quobyte-58c8f814-47cd-4630-9791-4a8dc88666cb" released by "delete_volume" :: held 3.936s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:50 devstack cinder-volume[86191]: WARNING cinder.quota [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:26:50 devstack cinder-volume[86191]: WARNING cinder.quota [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Created reservations ['aae2ad92-e6be-4d63-8575-581077ac1c53', '4d9f429c-b7bf-433b-9fad-6addac168b94', '6caa6062-cbd2-490b-9f19-bd25740ad541', '99e2e6fe-daee-4a52-80ba-f67048244e2d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:50 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:26:50 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:26:51 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Jul 06 15:26:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.746s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:26:51 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:26:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Deleted volume successfully. Jul 06 15:26:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a6ca350e-bff6-442b-9a83-bfa5a67e1d29 tempest-VolumesAdminNegativeTest-1040613447 None] Lock "cinder-58c8f814-47cd-4630-9791-4a8dc88666cb-delete_volume" released by "delete_volume" :: held 4.989s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Flow 'volume_create_manager' (6922d6f9-62f1-417b-b937-d5af94685a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0644bb82-1e3f-4226-abaf-d62fdb08e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0644bb82-1e3f-4226-abaf-d62fdb08e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97287009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f55545-6b89-4675-b808-b7c2892f9439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e9ffa31e314bce9fc388181686f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:59Z,use_quota=True,user_id='a5937d334819421f98c5ab6231c8a5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f4611a-3f42-417c-b301-3bbb1b46c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77f4611a-3f42-417c-b301-3bbb1b46c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4a17e0-cdcd-4a4b-bbc5-89338f877a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4a17e0-cdcd-4a4b-bbc5-89338f877a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f55545-6b89-4675-b808-b7c2892f9439', 'volume_name': 'volume-95f55545-6b89-4675-b808-b7c2892f9439', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aef8c44-2b8e-4f5b-a2ad-e983e65e4da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aef8c44-2b8e-4f5b-a2ad-e983e65e4da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70697d37-fcf2-41f5-ac68-468a3b5347a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:26:59 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Volume 95f55545-6b89-4675-b808-b7c2892f9439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f55545-6b89-4675-b808-b7c2892f9439', 'volume_size': 1} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-97287009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f55545-6b89-4675-b808-b7c2892f9439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e9ffa31e314bce9fc388181686f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:26:59Z,use_quota=True,user_id='a5937d334819421f98c5ab6231c8a5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Creating volume 95f55545-6b89-4675-b808-b7c2892f9439 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:26:59 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:26:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:26:59 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 1073741824 Jul 06 15:26:59 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:00 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 1073741824" returned: 0 in 1.143s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:00 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 Jul 06 15:27:00 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:01 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439" returned: 0 in 0.680s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70697d37-fcf2-41f5-ac68-468a3b5347a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f55545-6b89-4675-b808-b7c2892f9439', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aee027-031e-4a71-931b-b9fb5c20863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Volume volume-95f55545-6b89-4675-b808-b7c2892f9439 (95f55545-6b89-4675-b808-b7c2892f9439): created successfully Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aee027-031e-4a71-931b-b9fb5c20863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Flow 'volume_create_manager' (6922d6f9-62f1-417b-b937-d5af94685a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3d7bfcbe-485a-4f52-a5d9-c858ff23495b tempest-AttachVolumeTestJSON-1921022352 None] Created volume successfully. Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:06 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:27:06 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:08 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.198s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:08 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:27:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 8 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:27:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:27:09 devstack cinder-volume[86191]: WARNING py.warnings [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 06 15:27:09 devstack cinder-volume[86191]: .first() Jul 06 15:27:09 devstack cinder-volume[86191]: Jul 06 15:27:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0d574-aa76-4bbf-bf39-16d6eb17b97c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:09 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 Jul 06 15:27:09 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:10 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439" returned: 0 in 1.004s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.026s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-95f55545-6b89-4675-b808-b7c2892f9439', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c31ce4c-c102-42c0-b2bc-a084fd95a751', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:27:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-396fd4bf-0534-4c8c-824f-9e259a19c462 req-49702fff-3af3-4e80-a94b-ec17f0071071 tempest-AttachVolumeTestJSON-1921022352 None] attachment_update completed successfully. Jul 06 15:27:20 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=16,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:27:20 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:27:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3379ce-9dce-41a9-909f-cc5ae30c42e0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:25 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 Jul 06 15:27:25 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:26 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2" returned: 0 in 0.829s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-46badea9-fe8d-4449-b369-c77f0e90b1b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b366130e-b184-4251-a53c-135844133435', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:27:26 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-22a3ef55-ddea-4ec5-8ca4-37e017c8ce8f req-7768397c-3d6b-4ed0-8136-c7ad391fb509 tempest-TaggedAttachmentsTest-737532430 None] attachment_update completed successfully. Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Flow 'volume_create_manager' (61b34be5-64e2-4c49-b8b8-e963a242b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b567419f-7137-42b3-b8cc-1e2772442d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b567419f-7137-42b3-b8cc-1e2772442d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-835878607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51328dcc-cdd9-4122-a333-97074f848033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62834fc98b5b4620b45a0530b3a50fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:28Z,use_quota=True,user_id='2100d093383c4972918291eac7703a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8a7da7-c63d-44a2-b859-d32b9b360a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8a7da7-c63d-44a2-b859-d32b9b360a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2425f7d8-a1bd-42c7-8850-73d1892f1cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2425f7d8-a1bd-42c7-8850-73d1892f1cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51328dcc-cdd9-4122-a333-97074f848033', 'volume_name': 'volume-51328dcc-cdd9-4122-a333-97074f848033', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2451de-49c3-4dac-b7be-2a79e37002f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd2451de-49c3-4dac-b7be-2a79e37002f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaaddb6-2d4f-41de-9432-2fab0d405584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Volume 51328dcc-cdd9-4122-a333-97074f848033: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51328dcc-cdd9-4122-a333-97074f848033', 'volume_size': 1} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-835878607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51328dcc-cdd9-4122-a333-97074f848033,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62834fc98b5b4620b45a0530b3a50fe5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:28Z,use_quota=True,user_id='2100d093383c4972918291eac7703a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Creating volume 51328dcc-cdd9-4122-a333-97074f848033 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:27 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:27:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:27 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 1073741824 Jul 06 15:27:27 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:29 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 1073741824" returned: 0 in 1.333s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:29 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 Jul 06 15:27:29 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:30 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033" returned: 0 in 1.248s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] <== create_volume: return (2651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.657s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbaaddb6-2d4f-41de-9432-2fab0d405584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51328dcc-cdd9-4122-a333-97074f848033', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159e0443-f493-4f9a-bcba-42036810565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Volume volume-51328dcc-cdd9-4122-a333-97074f848033 (51328dcc-cdd9-4122-a333-97074f848033): created successfully Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (159e0443-f493-4f9a-bcba-42036810565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Flow 'volume_create_manager' (61b34be5-64e2-4c49-b8b8-e963a242b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-82d033c8-70f1-478d-bbd1-1faf4a0dc4c4 tempest-ServerActionsTestOtherA-649076072 None] Created volume successfully. Jul 06 15:27:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-7b56e4ad-0697-4f04-bc25-a6a572b14399 req-4462fa44-64b0-4554-8add-58512f432dae tempest-TaggedAttachmentsTest-737532430 None] Terminate volume connection completed successfully. Jul 06 15:27:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-7b56e4ad-0697-4f04-bc25-a6a572b14399 req-4462fa44-64b0-4554-8add-58512f432dae tempest-TaggedAttachmentsTest-737532430 None] Deleting attachment b366130e-b184-4251-a53c-135844133435. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:27:43 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:27:43 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Flow 'volume_create_manager' (f73f6e2f-fb69-42d5-bafe-86572d6d71a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfaf9ca-cfcb-4d05-b902-2bc4605df1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfaf9ca-cfcb-4d05-b902-2bc4605df1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-975224967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824a3c6d-497a-4adb-ad25-32fb08e45c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bd0c8f6c8d4820b26baa77c6fe8c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:50Z,use_quota=True,user_id='0eb769c976dd4d6ea259ed02d83228f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4eaaaf-cbef-4559-ba0b-f95153818dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4eaaaf-cbef-4559-ba0b-f95153818dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09b442d-bbc9-40cc-ad00-736b4f885278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09b442d-bbc9-40cc-ad00-736b4f885278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824a3c6d-497a-4adb-ad25-32fb08e45c50', 'volume_name': 'volume-824a3c6d-497a-4adb-ad25-32fb08e45c50', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f98ed44-9872-4dca-990e-f432273f2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f98ed44-9872-4dca-990e-f432273f2c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1298a1-328f-4e73-9ba2-efe57912c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Volume 824a3c6d-497a-4adb-ad25-32fb08e45c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824a3c6d-497a-4adb-ad25-32fb08e45c50', 'volume_size': 1} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-975224967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824a3c6d-497a-4adb-ad25-32fb08e45c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26bd0c8f6c8d4820b26baa77c6fe8c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:27:50Z,use_quota=True,user_id='0eb769c976dd4d6ea259ed02d83228f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Creating volume 824a3c6d-497a-4adb-ad25-32fb08e45c50 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:27:49 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:27:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:49 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 1073741824 Jul 06 15:27:49 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:50 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 1073741824" returned: 0 in 0.967s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:51 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 Jul 06 15:27:51 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:52 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50" returned: 0 in 1.036s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1298a1-328f-4e73-9ba2-efe57912c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824a3c6d-497a-4adb-ad25-32fb08e45c50', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134a4d20-e52f-4c70-bcc0-965f2c8058bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:27:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Volume volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 (824a3c6d-497a-4adb-ad25-32fb08e45c50): created successfully Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134a4d20-e52f-4c70-bcc0-965f2c8058bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:27:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Flow 'volume_create_manager' (f73f6e2f-fb69-42d5-bafe-86572d6d71a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:27:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b5c023ac-2f06-4caf-a7cd-e66f8b3f1875 tempest-DeleteServersTestJSON-533406550 None] Created volume successfully. Jul 06 15:27:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Acquiring lock "cinder-46badea9-fe8d-4449-b369-c77f0e90b1b2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Lock "cinder-46badea9-fe8d-4449-b369-c77f0e90b1b2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Acquiring lock "cinder-quobyte-46badea9-fe8d-4449-b369-c77f0e90b1b2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:27:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Lock "cinder-quobyte-46badea9-fe8d-4449-b369-c77f0e90b1b2" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:27:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6084d6-e066-431d-a9ca-ddb81795c49f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:55 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 Jul 06 15:27:55 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:56 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2" returned: 0 in 1.315s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:56 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2 Jul 06 15:27:56 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e39ecf-0e8a-4b2f-acb9-771d2669bcde]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:57 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 Jul 06 15:27:57 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-645d1350-2fed-426d-a28c-fe91839d34b5 req-95f0d890-822f-4766-92c3-be3855bad4ab tempest-AttachVolumeTestJSON-1921022352 None] Terminate volume connection completed successfully. Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-645d1350-2fed-426d-a28c-fe91839d34b5 req-95f0d890-822f-4766-92c3-be3855bad4ab tempest-AttachVolumeTestJSON-1921022352 None] Deleting attachment 7c31ce4c-c102-42c0-b2bc-a084fd95a751. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:27:57 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-46badea9-fe8d-4449-b369-c77f0e90b1b2" returned: 0 in 0.925s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Lock "cinder-quobyte-46badea9-fe8d-4449-b369-c77f0e90b1b2" released by "delete_volume" :: held 2.316s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Created reservations ['c5173546-416e-4d4d-af84-08ee95a0686a', '1d83d76a-ee64-43d1-85f9-a6664c549874', '172e82dd-4726-4a75-8334-e92750363c74', 'c240d517-8fe1-4149-877e-10cff81e274a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:27:57 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:27:57 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:27:58 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50" returned: 0 in 1.543s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.575s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:27:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-824a3c6d-497a-4adb-ad25-32fb08e45c50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab0b700c-8db6-4a11-8727-5458dbdea099', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:27:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-a856e5b9-c576-47b6-adea-cc5f47a8ed49 req-1ecca1d6-65f0-45cd-9f64-f0ef33387e9a tempest-DeleteServersTestJSON-533406550 None] attachment_update completed successfully. Jul 06 15:27:59 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Jul 06 15:27:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.215s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:27:59 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:27:59 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Deleted volume successfully. Jul 06 15:27:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1150a8ff-b3b3-46ce-93ca-93becd3bbcdc tempest-TaggedAttachmentsTest-737532430 None] Lock "cinder-46badea9-fe8d-4449-b369-c77f0e90b1b2-delete_volume" released by "delete_volume" :: held 3.824s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:06 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:28:06 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:07 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.866s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:28:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 8 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:28:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:28:08 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=13,cinder:INSERT=2,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:28:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-6a14b1fa-9f30-4301-a507-d301e2d4a4e8 req-d580338a-93e4-4f0a-a4b2-1f683833dc81 tempest-DeleteServersTestJSON-533406550 None] Terminate volume connection completed successfully. Jul 06 15:28:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-6a14b1fa-9f30-4301-a507-d301e2d4a4e8 req-d580338a-93e4-4f0a-a4b2-1f683833dc81 tempest-DeleteServersTestJSON-533406550 None] Deleting attachment ab0b700c-8db6-4a11-8727-5458dbdea099. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:28:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Acquiring lock "cinder-824a3c6d-497a-4adb-ad25-32fb08e45c50-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Lock "cinder-824a3c6d-497a-4adb-ad25-32fb08e45c50-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:14 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Acquiring lock "cinder-quobyte-824a3c6d-497a-4adb-ad25-32fb08e45c50" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:28:14 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Lock "cinder-quobyte-824a3c6d-497a-4adb-ad25-32fb08e45c50" acquired by "delete_volume" :: waited 0.041s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:28:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac293bd-2582-4f82-8f30-66485c5cd864]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:14 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 Jul 06 15:28:14 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:15 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50" returned: 0 in 1.047s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:15 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50 Jul 06 15:28:15 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:16 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-824a3c6d-497a-4adb-ad25-32fb08e45c50" returned: 0 in 0.990s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Lock "cinder-quobyte-824a3c6d-497a-4adb-ad25-32fb08e45c50" released by "delete_volume" :: held 2.104s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Created reservations ['cb0b0b98-a463-44dd-88cf-8ac77cf28b5f', '59fdc20e-d93a-4c00-b68c-f16c72a46d23', '05fe5668-fdd2-478a-bff9-1e30c9863f95', '3d76e3f3-167b-4a19-85a1-9e1445f5964b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:16 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:28:16 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:17 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.799s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:17 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:28:17 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Deleted volume successfully. Jul 06 15:28:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7969c0d9-e634-4f7c-aeab-016e2151479f tempest-DeleteServersTestJSON-533406550 None] Lock "cinder-824a3c6d-497a-4adb-ad25-32fb08e45c50-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:28:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c3bec-d937-473b-94d3-83c966b7bb69]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:19 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 Jul 06 15:28:19 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:20 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033" returned: 0 in 0.858s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.885s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-51328dcc-cdd9-4122-a333-97074f848033', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fe4a85f-9c5b-4b01-bd7f-b66217349bf0', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:28:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-575ffd02-c6c7-42b6-bfb3-1ef1f579fdb9 req-4f4162fa-a1e1-4b27-8c9b-5b97271cb0c5 tempest-ServerActionsTestOtherA-649076072 None] attachment_update completed successfully. Jul 06 15:28:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-63029850-9065-48c4-9e8c-2708369e7012 tempest-ServerActionsTestOtherA-649076072 None] Terminate volume connection completed successfully. Jul 06 15:28:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-63029850-9065-48c4-9e8c-2708369e7012 tempest-ServerActionsTestOtherA-649076072 None] Deleting attachment 0fe4a85f-9c5b-4b01-bd7f-b66217349bf0. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:28:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:28:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:28:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f649190-b1f5-4241-89ba-7fb3cf73e52b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:28:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:28:31 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 Jul 06 15:28:31 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:28:33 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Jul 06 15:28:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033" returned: 0 in 1.176s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:28:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.194s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:28:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-51328dcc-cdd9-4122-a333-97074f848033', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42d5b21f-7924-4e1f-9323-f06b530a79a5', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:28:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-cdd15b79-a968-4ef9-a67c-06b2bff929d2 req-de113921-45dc-4e84-b9b4-0e99e93ea2a3 tempest-ServerActionsTestOtherA-649076072 None] attachment_update completed successfully. Jul 06 15:28:43 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:28:43 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=24,cinder:SELECT=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Flow 'volume_create_manager' (365384a1-2bba-4fc8-b502-84af01a1796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1af94f3-82e0-4cc0-80ae-2cf19d8c61c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1af94f3-82e0-4cc0-80ae-2cf19d8c61c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-832452354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd8b0e7-a663-4231-b02c-152aff21198a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfd5658153e459886c434186c77dd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:03Z,use_quota=True,user_id='50098e609e9b486e800413321a07aa3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9160c8-d991-4a39-a32e-e0775800aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9160c8-d991-4a39-a32e-e0775800aae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c31a7e-ed2b-48fc-8da2-c63a45022248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c31a7e-ed2b-48fc-8da2-c63a45022248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bd8b0e7-a663-4231-b02c-152aff21198a', 'volume_name': 'volume-1bd8b0e7-a663-4231-b02c-152aff21198a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e21d107-b5d7-4e9a-91bb-fb5458c5b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e21d107-b5d7-4e9a-91bb-fb5458c5b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a2af7-8c02-4413-97c5-68fcb22a2d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Volume 1bd8b0e7-a663-4231-b02c-152aff21198a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bd8b0e7-a663-4231-b02c-152aff21198a', 'volume_size': 1} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-832452354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bd8b0e7-a663-4231-b02c-152aff21198a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfd5658153e459886c434186c77dd2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:03Z,use_quota=True,user_id='50098e609e9b486e800413321a07aa3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Creating volume 1bd8b0e7-a663-4231-b02c-152aff21198a {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:29:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:03 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a 1073741824 Jul 06 15:29:03 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:04 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a 1073741824" returned: 0 in 1.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:04 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a Jul 06 15:29:04 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:05 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a" returned: 0 in 1.109s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] <== create_volume: return (2960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.966s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d33a2af7-8c02-4413-97c5-68fcb22a2d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bd8b0e7-a663-4231-b02c-152aff21198a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6072d708-fd54-4d23-92ee-c8351c305144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Volume volume-1bd8b0e7-a663-4231-b02c-152aff21198a (1bd8b0e7-a663-4231-b02c-152aff21198a): created successfully Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6072d708-fd54-4d23-92ee-c8351c305144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Flow 'volume_create_manager' (365384a1-2bba-4fc8-b502-84af01a1796a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7493529d-5075-48ea-8ed3-0ae67f696d35 tempest-ServerRescueNegativeTestJSON-986468227 None] Created volume successfully. Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:06 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:29:06 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:08 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.470s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:11 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-ad249a88-fe1f-4c47-bab9-8c6e825080d2 req-074a3875-ecf7-4efd-852b-66263b83a7ff tempest-ServerActionsTestOtherA-649076072 None] Terminate volume connection completed successfully. Jul 06 15:29:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-ad249a88-fe1f-4c47-bab9-8c6e825080d2 req-074a3875-ecf7-4efd-852b-66263b83a7ff tempest-ServerActionsTestOtherA-649076072 None] Deleting attachment 42d5b21f-7924-4e1f-9323-f06b530a79a5. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:29:21 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:29:21 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:29:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "cinder-51328dcc-cdd9-4122-a333-97074f848033-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Lock "cinder-51328dcc-cdd9-4122-a333-97074f848033-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "cinder-quobyte-51328dcc-cdd9-4122-a333-97074f848033" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Lock "cinder-quobyte-51328dcc-cdd9-4122-a333-97074f848033" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:28 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[27596d09-d160-44a0-aaad-4e4d3a86454c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:28 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 Jul 06 15:29:28 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:29 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033" returned: 0 in 1.301s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:29 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033 Jul 06 15:29:29 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:30 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-51328dcc-cdd9-4122-a333-97074f848033" returned: 0 in 0.790s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Lock "cinder-quobyte-51328dcc-cdd9-4122-a333-97074f848033" released by "delete_volume" :: held 2.176s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Created reservations ['9514adc4-9a3a-4735-a86a-2b26eabf843c', '3c6678d8-f5f5-45a2-ac3c-8ecd971241d4', 'e3953016-9d54-4d89-9d41-3502214fef23', 'a1bac12d-009e-400a-8310-e3217d8a7ea5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:30 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:29:30 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:31 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.798s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:31 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Deleted volume successfully. Jul 06 15:29:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1459e906-4245-4a36-9696-c80f62494c44 tempest-ServerActionsTestOtherA-649076072 None] Lock "cinder-51328dcc-cdd9-4122-a333-97074f848033-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Acquiring lock "cinder-1bd8b0e7-a663-4231-b02c-152aff21198a-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "cinder-1bd8b0e7-a663-4231-b02c-152aff21198a-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Acquiring lock "cinder-quobyte-1bd8b0e7-a663-4231-b02c-152aff21198a" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "cinder-quobyte-1bd8b0e7-a663-4231-b02c-152aff21198a" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecca231-8bc5-415a-84a7-0a450b6ae9bb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:33 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a Jul 06 15:29:33 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a" returned: 0 in 2.068s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:34 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:34 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a Jul 06 15:29:34 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:36 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bd8b0e7-a663-4231-b02c-152aff21198a" returned: 0 in 1.187s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "cinder-quobyte-1bd8b0e7-a663-4231-b02c-152aff21198a" released by "delete_volume" :: held 3.427s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Created reservations ['41ce4c08-aea5-418a-b5ca-8a70f6403863', '44d6ff98-5329-4bef-a82f-82ffb7cd8d7d', '84abc14f-31e1-490b-a711-29525ebd920f', '4f496944-aa6c-424e-a189-0a174db3ed6e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:36 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:29:36 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:37 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.652s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Deleted volume successfully. Jul 06 15:29:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-54b6b74d-2367-4429-922f-65ab7a280d6c tempest-ServerRescueNegativeTestJSON-986468227 None] Lock "cinder-1bd8b0e7-a663-4231-b02c-152aff21198a-delete_volume" released by "delete_volume" :: held 4.551s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Flow 'volume_create_manager' (fcf3f816-d81f-4379-8dd5-1f2faa5f244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b244568-3d84-44ad-a7ae-1397f9f16f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b244568-3d84-44ad-a7ae-1397f9f16f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-87384426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4f8940-9953-41e3-b767-cefd6950a817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c14061f434dcbb67485050b521864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:40Z,use_quota=True,user_id='4b918693b5624407bdd52eae0b5e01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cf7f83-910a-4662-a15e-123a245a6532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cf7f83-910a-4662-a15e-123a245a6532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8722163-f62f-4215-8b10-41479e90267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8722163-f62f-4215-8b10-41479e90267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4f8940-9953-41e3-b767-cefd6950a817', 'volume_name': 'volume-fc4f8940-9953-41e3-b767-cefd6950a817', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9dbb0e-131f-4a52-8f90-585bab81ac0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec9dbb0e-131f-4a52-8f90-585bab81ac0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ef5080-82a2-4f40-939b-9299b1391a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Volume fc4f8940-9953-41e3-b767-cefd6950a817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4f8940-9953-41e3-b767-cefd6950a817', 'volume_size': 1} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-87384426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4f8940-9953-41e3-b767-cefd6950a817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c14061f434dcbb67485050b521864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:40Z,use_quota=True,user_id='4b918693b5624407bdd52eae0b5e01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Creating volume fc4f8940-9953-41e3-b767-cefd6950a817 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:40 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:29:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:40 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 1073741824 Jul 06 15:29:40 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:41 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 1073741824" returned: 0 in 1.013s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:41 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 Jul 06 15:29:41 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:42 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817" returned: 0 in 0.823s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ef5080-82a2-4f40-939b-9299b1391a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4f8940-9953-41e3-b767-cefd6950a817', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c830ad7-7360-4825-9e21-913626502ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Volume volume-fc4f8940-9953-41e3-b767-cefd6950a817 (fc4f8940-9953-41e3-b767-cefd6950a817): created successfully Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c830ad7-7360-4825-9e21-913626502ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Flow 'volume_create_manager' (fcf3f816-d81f-4379-8dd5-1f2faa5f244d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ff29f512-8644-4322-a6cf-329aa52220e9 tempest-ServersNegativeTestJSON-118842006 None] Created volume successfully. Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Flow 'volume_create_manager' (8564b3bb-591e-4386-b58c-28861ca63bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58769ae-6479-4a16-95ac-bc1e65a39737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58769ae-6479-4a16-95ac-bc1e65a39737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-764612845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242008d8-4aef-43bd-b1ca-adcd505c09f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c14061f434dcbb67485050b521864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:45Z,use_quota=True,user_id='4b918693b5624407bdd52eae0b5e01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643b156a-eea2-4bc3-bdb1-681a1cc30277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643b156a-eea2-4bc3-bdb1-681a1cc30277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6517cd-920e-4595-98be-63ee8cde73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6517cd-920e-4595-98be-63ee8cde73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242008d8-4aef-43bd-b1ca-adcd505c09f8', 'volume_name': 'volume-242008d8-4aef-43bd-b1ca-adcd505c09f8', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828d5519-b270-4966-9c72-72922dd01d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828d5519-b270-4966-9c72-72922dd01d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f954d3-3da7-48cf-a820-18da22618669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:45 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Volume 242008d8-4aef-43bd-b1ca-adcd505c09f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242008d8-4aef-43bd-b1ca-adcd505c09f8', 'volume_size': 1} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-764612845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242008d8-4aef-43bd-b1ca-adcd505c09f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c14061f434dcbb67485050b521864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:45Z,use_quota=True,user_id='4b918693b5624407bdd52eae0b5e01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Creating volume 242008d8-4aef-43bd-b1ca-adcd505c09f8 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:45 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:29:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:45 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 1073741824 Jul 06 15:29:45 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:46 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 1073741824" returned: 0 in 1.008s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:46 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 Jul 06 15:29:46 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Flow 'volume_create_manager' (64442223-5876-4612-99da-a292a8363e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee04ad-10d3-4bf5-b7cc-3287673aeed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ee04ad-10d3-4bf5-b7cc-3287673aeed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-514001412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db68c01b-31b6-4374-b905-4261adcea190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e9ffa31e314bce9fc388181686f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:47Z,use_quota=True,user_id='a5937d334819421f98c5ab6231c8a5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81ec353-8005-4464-b1f4-c521b4dda186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a81ec353-8005-4464-b1f4-c521b4dda186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6717e1c0-8189-48e2-beac-e9dd02b5f6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6717e1c0-8189-48e2-beac-e9dd02b5f6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db68c01b-31b6-4374-b905-4261adcea190', 'volume_name': 'volume-db68c01b-31b6-4374-b905-4261adcea190', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abbe4ba-5b8a-4ec8-ade9-9b6d6e02579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abbe4ba-5b8a-4ec8-ade9-9b6d6e02579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16435818-dd44-4a08-82ac-80696317c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Volume db68c01b-31b6-4374-b905-4261adcea190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db68c01b-31b6-4374-b905-4261adcea190', 'volume_size': 1} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:47 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8" returned: 0 in 0.724s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-514001412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db68c01b-31b6-4374-b905-4261adcea190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e9ffa31e314bce9fc388181686f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:29:47Z,use_quota=True,user_id='a5937d334819421f98c5ab6231c8a5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Creating volume db68c01b-31b6-4374-b905-4261adcea190 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:29:47 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f954d3-3da7-48cf-a820-18da22618669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242008d8-4aef-43bd-b1ca-adcd505c09f8', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:47 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 1073741824 Jul 06 15:29:47 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab8bfa-67bd-4143-b497-da46f0710cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Volume volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 (242008d8-4aef-43bd-b1ca-adcd505c09f8): created successfully Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ab8bfa-67bd-4143-b497-da46f0710cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Flow 'volume_create_manager' (8564b3bb-591e-4386-b58c-28861ca63bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a4fd7fca-9ee4-41f9-8187-14f626f270ee tempest-ServersNegativeTestJSON-118842006 None] Created volume successfully. Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "cinder-242008d8-4aef-43bd-b1ca-adcd505c09f8-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-242008d8-4aef-43bd-b1ca-adcd505c09f8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "cinder-quobyte-242008d8-4aef-43bd-b1ca-adcd505c09f8" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-quobyte-242008d8-4aef-43bd-b1ca-adcd505c09f8" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:48 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 1073741824" returned: 0 in 1.256s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[669f079a-1645-4c23-a366-daa93cc7fc85]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:48 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 Jul 06 15:29:48 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:48 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 Jul 06 15:29:48 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:49 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190" returned: 0 in 0.883s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16435818-dd44-4a08-82ac-80696317c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db68c01b-31b6-4374-b905-4261adcea190', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8d3586-da9c-42fe-ac06-1ef30706896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:29:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Volume volume-db68c01b-31b6-4374-b905-4261adcea190 (db68c01b-31b6-4374-b905-4261adcea190): created successfully Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd8d3586-da9c-42fe-ac06-1ef30706896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Flow 'volume_create_manager' (64442223-5876-4612-99da-a292a8363e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:29:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ea04e520-e865-4467-a7c0-701b1a627947 tempest-AttachVolumeTestJSON-1921022352 None] Created volume successfully. Jul 06 15:29:49 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8" returned: 0 in 1.088s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:49 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8 Jul 06 15:29:49 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:50 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-242008d8-4aef-43bd-b1ca-adcd505c09f8" returned: 0 in 0.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-quobyte-242008d8-4aef-43bd-b1ca-adcd505c09f8" released by "delete_volume" :: held 1.927s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Created reservations ['9ed02481-f946-47ec-a4c9-d03422a3fe58', '38195f7c-86bb-4cae-a605-04162f7b39da', '24d39b60-c8f1-4e56-a33b-074002373392', 'f86b468b-9dac-4a1e-8034-4f800d3ddd88'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:50 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:29:50 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:51 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.685s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Deleted volume successfully. Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-940ec35b-fa56-4784-8157-b085499e1db3 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-242008d8-4aef-43bd-b1ca-adcd505c09f8-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "cinder-fc4f8940-9953-41e3-b767-cefd6950a817-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-fc4f8940-9953-41e3-b767-cefd6950a817-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "cinder-quobyte-fc4f8940-9953-41e3-b767-cefd6950a817" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-quobyte-fc4f8940-9953-41e3-b767-cefd6950a817" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c86adea-a3b5-4842-ad98-24ce242de69c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:51 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 Jul 06 15:29:51 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:52 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817" returned: 0 in 0.833s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:52 devstack sudo[92080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817 Jul 06 15:29:52 devstack sudo[92080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:53 devstack sudo[92080]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc4f8940-9953-41e3-b767-cefd6950a817" returned: 0 in 0.886s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-quobyte-fc4f8940-9953-41e3-b767-cefd6950a817" released by "delete_volume" :: held 1.764s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Created reservations ['920941c8-8318-481e-8451-c2cb41c5fe9c', '4e6accde-bca5-4f94-825f-864014616d5d', '7056f68f-a7a6-4cce-99ff-add51061a37d', '7982a122-7e5f-4a7e-84da-1cba8c1ad5a6'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b63b7-1470-466a-b162-60816d459eee]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:29:53 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:29:53 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:53 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 Jul 06 15:29:53 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:29:54 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190" returned: 0 in 1.007s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.045s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:29:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-db68c01b-31b6-4374-b905-4261adcea190', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88a5a772-c5e7-4775-8a08-b4c51ffda9e1', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:29:54 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Jul 06 15:29:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.017s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:29:54 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:29:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Deleted volume successfully. Jul 06 15:29:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e44a7cfc-a3fe-409c-b581-9f6ab5dbf9e0 tempest-ServersNegativeTestJSON-118842006 None] Lock "cinder-fc4f8940-9953-41e3-b767-cefd6950a817-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:29:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-af94a5ab-bd4a-4e46-881d-ffc9b0a489ef req-bd360313-b81c-4867-a5e5-6d705b5e0796 tempest-AttachVolumeTestJSON-1921022352 None] attachment_update completed successfully. Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Flow 'volume_create_manager' (8f64f829-19b3-4863-afe9-5681951516f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a6fa87-b239-4a34-8762-8045d3edc530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a6fa87-b239-4a34-8762-8045d3edc530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1707668300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4601b2fb-1499-43e9-8524-7e9768f9e0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e9ffa31e314bce9fc388181686f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:00Z,use_quota=True,user_id='a5937d334819421f98c5ab6231c8a5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb1f98d-75bc-4dbd-a3c5-2339c68e30f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb1f98d-75bc-4dbd-a3c5-2339c68e30f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48da00ef-6765-4d90-a664-d7b5e35a0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48da00ef-6765-4d90-a664-d7b5e35a0e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4601b2fb-1499-43e9-8524-7e9768f9e0fb', 'volume_name': 'volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b035146-2239-4906-8b57-4ce2010f3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b035146-2239-4906-8b57-4ce2010f3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b666a2-b9b0-4942-89a9-0e2df0950bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:00 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Volume 4601b2fb-1499-43e9-8524-7e9768f9e0fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb', 'volume_size': 1} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1707668300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4601b2fb-1499-43e9-8524-7e9768f9e0fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e9ffa31e314bce9fc388181686f660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:00Z,use_quota=True,user_id='a5937d334819421f98c5ab6231c8a5e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Creating volume 4601b2fb-1499-43e9-8524-7e9768f9e0fb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:00 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:00 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb 1073741824 Jul 06 15:30:00 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:01 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb 1073741824" returned: 0 in 1.361s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:02 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb Jul 06 15:30:02 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:02 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb" returned: 0 in 0.868s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b666a2-b9b0-4942-89a9-0e2df0950bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6aee67-c64e-428a-a488-a6a64338f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Volume volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb (4601b2fb-1499-43e9-8524-7e9768f9e0fb): created successfully Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba6aee67-c64e-428a-a488-a6a64338f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Flow 'volume_create_manager' (8f64f829-19b3-4863-afe9-5681951516f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-49566deb-492b-4bbf-b704-1925a9e52f59 tempest-AttachVolumeTestJSON-1921022352 None] Created volume successfully. Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:06 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:06 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Flow 'volume_create_manager' (a2a1d6e4-0ae6-4340-b798-7a912b5d935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959b0dde-93c1-4c59-ab98-5fb59b95c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959b0dde-93c1-4c59-ab98-5fb59b95c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-744810798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dad1e5-40e8-4dd2-9a18-bdcd9993269c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7393eab99a45ed821ee19416e3420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:07Z,use_quota=True,user_id='778ff0651dd547cbabb1e8ef354f1b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707cda29-61bc-4711-a0b6-d39c3baa4d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (707cda29-61bc-4711-a0b6-d39c3baa4d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80ebf3e-163f-4136-a438-8c72ee0c9fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80ebf3e-163f-4136-a438-8c72ee0c9fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37dad1e5-40e8-4dd2-9a18-bdcd9993269c', 'volume_name': 'volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f24c322-c508-4a8c-a9bb-21bf4e513cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f24c322-c508-4a8c-a9bb-21bf4e513cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796d4b6d-4e67-4159-9516-9f8da59847bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:07 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Volume 37dad1e5-40e8-4dd2-9a18-bdcd9993269c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c', 'volume_size': 1} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-744810798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37dad1e5-40e8-4dd2-9a18-bdcd9993269c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7393eab99a45ed821ee19416e3420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:07Z,use_quota=True,user_id='778ff0651dd547cbabb1e8ef354f1b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Creating volume 37dad1e5-40e8-4dd2-9a18-bdcd9993269c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:07 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:07 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c 1073741824 Jul 06 15:30:07 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:07 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.782s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 8 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:30:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:30:08 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c 1073741824" returned: 0 in 0.928s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:08 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c Jul 06 15:30:08 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:08 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c" returned: 0 in 0.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.660s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796d4b6d-4e67-4159-9516-9f8da59847bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1f6a42-7e0d-4b7b-8f32-a2c6905f6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddbf8ea-8de6-49f1-98b5-52436ef1272a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Volume volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c (37dad1e5-40e8-4dd2-9a18-bdcd9993269c): created successfully Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1f6a42-7e0d-4b7b-8f32-a2c6905f6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Flow 'volume_create_manager' (a2a1d6e4-0ae6-4340-b798-7a912b5d935b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b31c63f0-3e63-4b3d-b7c6-b18e7c049298 tempest-VolumesTestJSON-1646975882 None] Created volume successfully. Jul 06 15:30:08 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb Jul 06 15:30:08 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Flow 'volume_create_manager' (94a6b2be-ae6d-40dd-97a6-e34dd6221858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2b2075-5ebb-4fa4-b44d-9a31d22377e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:09 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb" returned: 0 in 1.079s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.125s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2b2075-5ebb-4fa4-b44d-9a31d22377e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-149702903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566eaf68-190e-49eb-b602-c9c6d73b1209,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7393eab99a45ed821ee19416e3420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:10Z,use_quota=True,user_id='778ff0651dd547cbabb1e8ef354f1b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b049451-9f8d-41cd-86cb-17234771a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b049451-9f8d-41cd-86cb-17234771a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4c7142-c3a4-4f69-954e-95e735911641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4c7142-c3a4-4f69-954e-95e735911641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566eaf68-190e-49eb-b602-c9c6d73b1209', 'volume_name': 'volume-566eaf68-190e-49eb-b602-c9c6d73b1209', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e633722b-6cbf-4cb0-b8c7-1b262ae106ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e633722b-6cbf-4cb0-b8c7-1b262ae106ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5ae729-c6bf-468c-aadb-6e6175731fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:09 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Volume 566eaf68-190e-49eb-b602-c9c6d73b1209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566eaf68-190e-49eb-b602-c9c6d73b1209', 'volume_size': 1} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-149702903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566eaf68-190e-49eb-b602-c9c6d73b1209,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7393eab99a45ed821ee19416e3420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:10Z,use_quota=True,user_id='778ff0651dd547cbabb1e8ef354f1b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Creating volume 566eaf68-190e-49eb-b602-c9c6d73b1209 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:09 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:09 devstack sudo[92578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 1073741824 Jul 06 15:30:09 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b83e8190-7f76-4c35-a9f7-0f79414e7fa2', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:30:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-7d4aeec3-3351-41c5-9063-5a13950a0359 req-2e860280-f4fd-4e5c-bb30-b37f84530033 tempest-AttachVolumeTestJSON-1921022352 None] attachment_update completed successfully. Jul 06 15:30:11 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 1073741824" returned: 0 in 1.086s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:11 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 Jul 06 15:30:11 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:11 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209" returned: 0 in 0.877s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5ae729-c6bf-468c-aadb-6e6175731fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566eaf68-190e-49eb-b602-c9c6d73b1209', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e5c24f-8a69-48e3-80e4-ccdecbe6f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:12 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Volume volume-566eaf68-190e-49eb-b602-c9c6d73b1209 (566eaf68-190e-49eb-b602-c9c6d73b1209): created successfully Jul 06 15:30:12 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e5c24f-8a69-48e3-80e4-ccdecbe6f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:12 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Flow 'volume_create_manager' (94a6b2be-ae6d-40dd-97a6-e34dd6221858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e10b79ba-1778-418d-854c-6862fb08b7ed tempest-VolumesTestJSON-1646975882 None] Created volume successfully. Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Flow 'volume_create_manager' (43d9f79b-4a11-4ff2-9748-1ce65d1d6e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5357c106-b054-47bf-bb0c-5f904424a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5357c106-b054-47bf-bb0c-5f904424a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1160924393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7393eab99a45ed821ee19416e3420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:14Z,use_quota=True,user_id='778ff0651dd547cbabb1e8ef354f1b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfd3ada-1012-4f48-bdee-cb66d08a921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acfd3ada-1012-4f48-bdee-cb66d08a921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0703d055-3a85-4183-b2a9-efd5a1eeb65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0703d055-3a85-4183-b2a9-efd5a1eeb65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c', 'volume_name': 'volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093dad23-6e4b-4500-9179-41d47b7100e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093dad23-6e4b-4500-9179-41d47b7100e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05576217-15ad-44a7-91d8-ebf86cbb78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:13 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Volume aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c', 'volume_size': 1} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1160924393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f7393eab99a45ed821ee19416e3420d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:14Z,use_quota=True,user_id='778ff0651dd547cbabb1e8ef354f1b0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Creating volume aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:13 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:13 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c 1073741824 Jul 06 15:30:13 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:14 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c 1073741824" returned: 0 in 1.003s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:14 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c Jul 06 15:30:14 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:15 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c" returned: 0 in 0.718s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05576217-15ad-44a7-91d8-ebf86cbb78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8b5da4-193e-4053-bdf2-5adb74c2a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:15 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Volume volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c (aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c): created successfully Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d8b5da4-193e-4053-bdf2-5adb74c2a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Flow 'volume_create_manager' (43d9f79b-4a11-4ff2-9748-1ce65d1d6e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ce28803e-570d-4733-9cee-11d3e05520ae tempest-VolumesTestJSON-1646975882 None] Created volume successfully. Jul 06 15:30:16 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-24d063cf-5d0f-4c9e-aecd-7d68ec7faf3d req-6632e7a7-d5c3-4ebc-bce0-047d4c45ac1f tempest-AttachVolumeTestJSON-1921022352 None] Terminate volume connection completed successfully. Jul 06 15:30:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-24d063cf-5d0f-4c9e-aecd-7d68ec7faf3d req-6632e7a7-d5c3-4ebc-bce0-047d4c45ac1f tempest-AttachVolumeTestJSON-1921022352 None] Deleting attachment 88a5a772-c5e7-4775-8a08-b4c51ffda9e1. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:30:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Acquiring lock "cinder-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Lock "cinder-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Acquiring lock "cinder-quobyte-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Lock "cinder-quobyte-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:17 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4f5aea-48e0-4248-b1b6-16fd4db1868f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:17 devstack sudo[92702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c Jul 06 15:30:17 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:18 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c" returned: 0 in 0.866s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:18 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c Jul 06 15:30:18 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:19 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c" returned: 0 in 1.073s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Lock "cinder-quobyte-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c" released by "delete_volume" :: held 1.999s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Created reservations ['69d1afd5-f0eb-4bef-8f3f-dd1e5bc9b625', 'd63a34cb-0bf3-45b9-9ffa-7b3252598c16', '18d4eb3d-19f3-487e-8217-2181041ebc8e', '45fd24e0-f85f-4b6c-9b6b-49484b653a3e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:19 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:19 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Acquiring lock "cinder-566eaf68-190e-49eb-b602-c9c6d73b1209-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Lock "cinder-566eaf68-190e-49eb-b602-c9c6d73b1209-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Acquiring lock "cinder-quobyte-566eaf68-190e-49eb-b602-c9c6d73b1209" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Lock "cinder-quobyte-566eaf68-190e-49eb-b602-c9c6d73b1209" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[51773e0a-35fc-4fcb-8024-c996b6562d9a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:20 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 Jul 06 15:30:20 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:20 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.212s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:20 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Deleted volume successfully. Jul 06 15:30:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1cbe2348-03e8-4cb0-bf54-2d36fd1c64ea tempest-VolumesTestJSON-1646975882 None] Lock "cinder-aeda7da5-cfe9-4a5e-bdf4-8860ec02d86c-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:21 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-2c601017-1aa2-4f99-82d0-7a5b7f5a43ba req-224b9c60-418a-4d2c-a308-9ef35a1feee1 tempest-AttachVolumeTestJSON-1921022352 None] Terminate volume connection completed successfully. Jul 06 15:30:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-2c601017-1aa2-4f99-82d0-7a5b7f5a43ba req-224b9c60-418a-4d2c-a308-9ef35a1feee1 tempest-AttachVolumeTestJSON-1921022352 None] Deleting attachment b83e8190-7f76-4c35-a9f7-0f79414e7fa2. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:30:21 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209" returned: 0 in 1.510s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:21 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209 Jul 06 15:30:21 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:22 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-566eaf68-190e-49eb-b602-c9c6d73b1209" returned: 0 in 1.122s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Lock "cinder-quobyte-566eaf68-190e-49eb-b602-c9c6d73b1209" released by "delete_volume" :: held 2.729s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=58,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=50,cinder:INSERT=14,cinder:UPDATE=67,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Created reservations ['b0472086-3681-4703-a0e5-a7a6e2ea5b18', '0207c026-2016-4ecb-9f63-f96fbcbd29e5', '40d0bd69-8581-42a7-b4c0-a9f6337c66da', '526efbaa-d82a-4c8e-9fcf-d5f2b945a1cc'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:22 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:22 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Acquiring lock "cinder-37dad1e5-40e8-4dd2-9a18-bdcd9993269c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Lock "cinder-37dad1e5-40e8-4dd2-9a18-bdcd9993269c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Acquiring lock "cinder-quobyte-37dad1e5-40e8-4dd2-9a18-bdcd9993269c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Lock "cinder-quobyte-37dad1e5-40e8-4dd2-9a18-bdcd9993269c" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:23 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6585b43-1b02-494f-a283-13dff3c2beb4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:24 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c Jul 06 15:30:24 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:24 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.446s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:24 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Deleted volume successfully. Jul 06 15:30:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e9607eac-25d1-42f9-a727-d309887e750a tempest-VolumesTestJSON-1646975882 None] Lock "cinder-566eaf68-190e-49eb-b602-c9c6d73b1209-delete_volume" released by "delete_volume" :: held 4.641s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:25 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c" returned: 0 in 1.722s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:25 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c Jul 06 15:30:25 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:26 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37dad1e5-40e8-4dd2-9a18-bdcd9993269c" returned: 0 in 1.272s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Lock "cinder-quobyte-37dad1e5-40e8-4dd2-9a18-bdcd9993269c" released by "delete_volume" :: held 3.058s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:26 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Created reservations ['77acf533-bc3f-4980-b6d1-f7f76bcb7bd1', '420c0f02-d637-4293-8e84-9c6bf73302fa', '6c9fc589-cd63-448d-ab79-d29f0e93f1cf', 'f64589e7-09bd-4014-8192-99450ae85974'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:27 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:27 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:28 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.086s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:28 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Deleted volume successfully. Jul 06 15:30:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c144f1d-9111-4c25-b52d-268dcfbf7535 tempest-VolumesTestJSON-1646975882 None] Lock "cinder-37dad1e5-40e8-4dd2-9a18-bdcd9993269c-delete_volume" released by "delete_volume" :: held 4.620s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "cinder-4601b2fb-1499-43e9-8524-7e9768f9e0fb-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-4601b2fb-1499-43e9-8524-7e9768f9e0fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "cinder-quobyte-4601b2fb-1499-43e9-8524-7e9768f9e0fb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-quobyte-4601b2fb-1499-43e9-8524-7e9768f9e0fb" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2616a30-deaa-4098-bdf2-707814bdf886]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:34 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb Jul 06 15:30:34 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:35 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb" returned: 0 in 0.909s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:35 devstack sudo[92848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb Jul 06 15:30:35 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:36 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4601b2fb-1499-43e9-8524-7e9768f9e0fb" returned: 0 in 0.716s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-quobyte-4601b2fb-1499-43e9-8524-7e9768f9e0fb" released by "delete_volume" :: held 1.671s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Created reservations ['147247e0-85f5-4ffe-b928-1c466b038dcf', '8644e23c-2ab8-4557-a742-0509eede97f0', 'eceb7f08-40bd-468b-9a47-cb8afca4c958', '66a32133-89a5-4828-8507-45f79fb5e244'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:36 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:36 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "cinder-db68c01b-31b6-4374-b905-4261adcea190-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-db68c01b-31b6-4374-b905-4261adcea190-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "cinder-quobyte-db68c01b-31b6-4374-b905-4261adcea190" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-quobyte-db68c01b-31b6-4374-b905-4261adcea190" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc43449-1b91-4690-a575-79fa744cdab8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:36 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 Jul 06 15:30:36 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:37 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.848s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Deleted volume successfully. Jul 06 15:30:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f3682c6a-97a5-4c0d-a285-8465e9407b36 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-4601b2fb-1499-43e9-8524-7e9768f9e0fb-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:37 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190" returned: 0 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:37 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190 Jul 06 15:30:37 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5dcdc693-893c-4c7d-8da7-c5d6c9db917f tempest-BackendsCapabilitiesAdminTestsJSON-690439712 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755241394043, 'free_capacity_gb': 1775.755241394043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86191) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 15:30:38 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db68c01b-31b6-4374-b905-4261adcea190" returned: 0 in 0.714s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-quobyte-db68c01b-31b6-4374-b905-4261adcea190" released by "delete_volume" :: held 1.624s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Created reservations ['68044b9a-5349-4f76-8593-4e3e4c1e8c06', '42f80a18-6d49-45c4-b249-438f2897f028', 'be60e3d6-8bea-41d7-b11c-057673a646e9', 'fcd7e2f5-74b1-45b4-9ddf-0a617b2177ce'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ef828af7-fc5f-463e-af1c-876ec13ce933 tempest-BackendsCapabilitiesAdminTestsJSON-690439712 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755241394043, 'free_capacity_gb': 1775.755241394043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86191) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:38 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:38 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "cinder-95f55545-6b89-4675-b808-b7c2892f9439-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-95f55545-6b89-4675-b808-b7c2892f9439-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "cinder-quobyte-95f55545-6b89-4675-b808-b7c2892f9439" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-quobyte-95f55545-6b89-4675-b808-b7c2892f9439" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[493cefa9-2c90-440c-b119-aefd85f0d18b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:39 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:39 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 Jul 06 15:30:39 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.807s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Deleted volume successfully. Jul 06 15:30:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d4c0c912-da34-4fef-90eb-549ba8b30962 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-db68c01b-31b6-4374-b905-4261adcea190-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:40 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439" returned: 0 in 0.897s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:40 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439 Jul 06 15:30:40 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:40 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-95f55545-6b89-4675-b808-b7c2892f9439" returned: 0 in 0.795s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-quobyte-95f55545-6b89-4675-b808-b7c2892f9439" released by "delete_volume" :: held 1.742s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Created reservations ['f10c1a3b-5f03-49f5-88d9-f61d110f54b3', 'c1ce7e0f-7bea-454c-8ac7-dd50d00b9b5e', '90a63722-4cc8-409b-bebc-ccf4cdbd5e5b', '1b6f3133-c7bd-4130-9983-78a9abc00b4f'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:41 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:41 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:41 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.833s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:41 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:41 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Deleted volume successfully. Jul 06 15:30:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c01ae4a-2c75-43d9-b550-a498424d5964 tempest-AttachVolumeTestJSON-1921022352 None] Lock "cinder-95f55545-6b89-4675-b808-b7c2892f9439-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0f0d909f-ac14-47f4-905e-95a25788f23c tempest-GroupsTest-1395743444 None] Group tempest-Group1-499496250: creating Jul 06 15:30:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0f0d909f-ac14-47f4-905e-95a25788f23c tempest-GroupsTest-1395743444 None] Group tempest-Group1-499496250: created successfully Jul 06 15:30:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0f0d909f-ac14-47f4-905e-95a25788f23c tempest-GroupsTest-1395743444 None] Create group completed successfully. Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Flow 'volume_create_manager' (1c2f188e-8a79-4869-ab4e-609d1ed860da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f189bc2-d203-4f13-ba90-ad6fbc8607c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f189bc2-d203-4f13-ba90-ad6fbc8607c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-878057791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8ed6d9-162f-40da-8a55-db91c301a747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a9e0d7ed6846b8a32392f269952e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:47Z,use_quota=True,user_id='29a603f8b4fe40a48a16f3838677d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529ad948-8841-4b0a-aa21-23242046e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529ad948-8841-4b0a-aa21-23242046e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c540b266-d7e7-4316-b4f8-beb782ac15eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c540b266-d7e7-4316-b4f8-beb782ac15eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8ed6d9-162f-40da-8a55-db91c301a747', 'volume_name': 'volume-8e8ed6d9-162f-40da-8a55-db91c301a747', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6198c75-20fd-4a00-af9d-4f27e3baacfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6198c75-20fd-4a00-af9d-4f27e3baacfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652d35b3-08a0-4f41-942c-eec2f10c38e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Volume 8e8ed6d9-162f-40da-8a55-db91c301a747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8ed6d9-162f-40da-8a55-db91c301a747', 'volume_size': 1} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-878057791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8ed6d9-162f-40da-8a55-db91c301a747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a9e0d7ed6846b8a32392f269952e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:47Z,use_quota=True,user_id='29a603f8b4fe40a48a16f3838677d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Creating volume 8e8ed6d9-162f-40da-8a55-db91c301a747 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:47 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:47 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 1073741824 Jul 06 15:30:47 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-eb44b2dd-9dbb-4b28-8f23-67bd1fb47057 tempest-GroupsTest-1395743444 None] Group tempest-Group2-1418565967: creating Jul 06 15:30:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-eb44b2dd-9dbb-4b28-8f23-67bd1fb47057 tempest-GroupsTest-1395743444 None] Group tempest-Group2-1418565967: created successfully Jul 06 15:30:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-eb44b2dd-9dbb-4b28-8f23-67bd1fb47057 tempest-GroupsTest-1395743444 None] Create group completed successfully. Jul 06 15:30:48 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 1073741824" returned: 0 in 1.164s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:48 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 Jul 06 15:30:48 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:49 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747" returned: 0 in 0.885s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652d35b3-08a0-4f41-942c-eec2f10c38e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8ed6d9-162f-40da-8a55-db91c301a747', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28162e4-50d9-4633-a182-34c2c644e3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Volume volume-8e8ed6d9-162f-40da-8a55-db91c301a747 (8e8ed6d9-162f-40da-8a55-db91c301a747): created successfully Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28162e4-50d9-4633-a182-34c2c644e3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Flow 'volume_create_manager' (1c2f188e-8a79-4869-ab4e-609d1ed860da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c36d5c61-5628-49af-99a3-da7e8bb000ca tempest-AttachVolumeNegativeTest-2045782107 None] Created volume successfully. Jul 06 15:30:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Flow 'volume_create_manager' (fbb13543-d7dd-4123-87b8-3664d489827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef53971-daac-4554-91f4-ab5063937765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef53971-daac-4554-91f4-ab5063937765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319860030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4fbb33e-5714-443b-9cb4-acf64c2259a4,host='devstack@QuobyteHD#QuobyteHD',id=38f93bf7-6cf4-44bc-8e49-4b483fb60e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9f49b309e439aadfb6d7b8e0f44a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:50Z,use_quota=True,user_id='e5cb742cf5dc43758c79fae83a040750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(140288da-d44b-4db2-bf5e-69f0197e0d99),volume_type_id=140288da-d44b-4db2-bf5e-69f0197e0d99)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a658e44-ac16-4121-831c-28f8c154e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a658e44-ac16-4121-831c-28f8c154e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f60c6c0-63f0-480c-a268-16d4ec8b02e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f60c6c0-63f0-480c-a268-16d4ec8b02e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f93bf7-6cf4-44bc-8e49-4b483fb60e1c', 'volume_name': 'volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6337f1a4-ade2-4539-8012-cce6833f751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6337f1a4-ade2-4539-8012-cce6833f751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca930c0-fea0-4740-bad8-202cfb35f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:50 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Volume 38f93bf7-6cf4-44bc-8e49-4b483fb60e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c', 'volume_size': 1} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b4fbb33e-5714-443b-9cb4-acf64c2259a4,created_at=2026-07-06T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1319860030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4fbb33e-5714-443b-9cb4-acf64c2259a4,host='devstack@QuobyteHD#QuobyteHD',id=38f93bf7-6cf4-44bc-8e49-4b483fb60e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9f49b309e439aadfb6d7b8e0f44a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:50Z,use_quota=True,user_id='e5cb742cf5dc43758c79fae83a040750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(140288da-d44b-4db2-bf5e-69f0197e0d99),volume_type_id=140288da-d44b-4db2-bf5e-69f0197e0d99)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Creating volume 38f93bf7-6cf4-44bc-8e49-4b483fb60e1c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:50 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:50 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c 1073741824 Jul 06 15:30:50 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:51 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c 1073741824" returned: 0 in 1.013s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Flow 'volume_create_manager' (e7e3bc0c-ea08-4900-ad27-44df968cfd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6c88e9-3548-471d-a946-628c64148f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c6c88e9-3548-471d-a946-628c64148f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1889229630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2fea93a8c64b7592df20d23bcf2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:51Z,use_quota=True,user_id='6ebca64f2a7e4e87a3fbbb664c6428c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c8b1fd-ef82-4311-a39b-9a3b148bf62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c8b1fd-ef82-4311-a39b-9a3b148bf62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6731626-dcee-4c5f-88cf-f21236a90885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6731626-dcee-4c5f-88cf-f21236a90885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642', 'volume_name': 'volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab514e6-77d3-4f7a-ba52-bc8e290d43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab514e6-77d3-4f7a-ba52-bc8e290d43c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baac1a02-66db-44d9-9f16-58c9019a991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Volume ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642', 'volume_size': 1} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:51 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c Jul 06 15:30:51 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:51 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1889229630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad2fea93a8c64b7592df20d23bcf2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:51Z,use_quota=True,user_id='6ebca64f2a7e4e87a3fbbb664c6428c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Creating volume ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:30:51 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:30:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:52 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 1073741824 Jul 06 15:30:52 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ca930c0-fea0-4740-bad8-202cfb35f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3363d038-a10c-475e-9d20-e02cc2724261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Volume volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c (38f93bf7-6cf4-44bc-8e49-4b483fb60e1c): created successfully Jul 06 15:30:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3363d038-a10c-475e-9d20-e02cc2724261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Flow 'volume_create_manager' (fbb13543-d7dd-4123-87b8-3664d489827c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6e0c57a3-72f0-4abf-8622-249bc1bee76a tempest-GroupsTest-1395743444 None] Created volume successfully. Jul 06 15:30:53 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 1073741824" returned: 0 in 1.041s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Acquiring lock "cinder-quobyte-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Lock "cinder-quobyte-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:30:53 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 Jul 06 15:30:53 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d420d78-0dbc-4df0-b640-b8395a0da2fb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:53 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c Jul 06 15:30:53 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:53 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" returned: 0 in 0.794s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baac1a02-66db-44d9-9f16-58c9019a991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3059f136-e9c6-4d1e-a501-8999bea79fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:53 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Volume volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 (ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642): created successfully Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3059f136-e9c6-4d1e-a501-8999bea79fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Flow 'volume_create_manager' (e7e3bc0c-ea08-4900-ad27-44df968cfd4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aff303-4765-440a-b1c7-df27d88d2b7d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-5b1895ea-1d54-40d7-a487-44cd8555c642 req-88adb384-f1de-4b51-a14a-40d4519d4985 tempest-VolumesSnapshotsTestJSON-445486857 None] Created volume successfully. Jul 06 15:30:54 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c" returned: 0 in 0.942s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:54 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 Jul 06 15:30:54 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:54 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c Jul 06 15:30:54 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:54 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c" returned: 0 in 0.798s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:54 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747" returned: 0 in 0.926s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Lock "cinder-quobyte-38f93bf7-6cf4-44bc-8e49-4b483fb60e1c" released by "delete_volume" :: held 1.787s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-8e8ed6d9-162f-40da-8a55-db91c301a747', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd66ed56f-152d-4ad9-a59c-185424f13dec', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:30:54 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Created reservations ['1ebbf86a-abe8-4caf-8f35-8b5405d7da1b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-b4418b1c-f511-447f-a415-f67af1fe66e3 req-36614a2b-8f2a-46ae-a885-ed63b3e69e5b tempest-AttachVolumeNegativeTest-2045782107 None] attachment_update completed successfully. Jul 06 15:30:55 devstack cinder-volume[86191]: WARNING cinder.quota [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-753643041 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-753643041, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:30:55 devstack cinder-volume[86191]: WARNING cinder.quota [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-753643041 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-753643041, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Created reservations ['6524cca2-0e7c-434e-b5ca-d6b14af1320e', '78b4e86b-f9fb-4d8f-af51-fc7d3b4bc352', 'dd5afd40-af94-4522-8fbe-a171a6e2d299', '3e1e879a-2140-464d-86f2-3723ca216dc4'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Creating offline snapshot 3954b6a5-98c0-41f2-924a-9afe69213fd0 of volume ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2433ab09-dd24-41d4-9273-b27e73b1905e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:55 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:55 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:55 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 Jul 06 15:30:55 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Created reservations ['a7dbe8f0-149e-4bfe-97a3-0cc6c41009a9'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:30:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:55 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:30:55 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:56 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.951s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:56 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4df80657-eee5-48d3-bcb6-b7ff902cba4e tempest-GroupsTest-1395743444 None] Delete group completed successfully. Jul 06 15:30:56 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" returned: 0 in 1.167s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:56 devstack sudo[93429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 1G Jul 06 15:30:56 devstack sudo[93429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:56 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.980s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:56 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:30:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-841fefb5-69dd-4bac-9f58-5e2b438bf06c tempest-GroupsTest-1395743444 None] Delete group completed successfully. Jul 06 15:30:57 devstack sudo[93429]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 1G" returned: 0 in 1.174s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:57 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 Jul 06 15:30:57 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d1a1b318-e14e-4a13-979f-9830de431398 tempest-GroupsTest-1395743444 None] Group tempest-GroupsTest-Group-1623779905: creating Jul 06 15:30:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d1a1b318-e14e-4a13-979f-9830de431398 tempest-GroupsTest-1395743444 None] Group tempest-GroupsTest-Group-1623779905: created successfully Jul 06 15:30:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d1a1b318-e14e-4a13-979f-9830de431398 tempest-GroupsTest-1395743444 None] Create group completed successfully. Jul 06 15:30:58 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0" returned: 0 in 0.702s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:58 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 is being set with open permissions: ugo+rw Jul 06 15:30:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:58 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 Jul 06 15:30:58 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:58 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0" returned: 0 in 0.658s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:58 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info Jul 06 15:30:58 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Flow 'volume_create_manager' (90658756-c1fb-4d20-a24f-6cf74624db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc27586-8bee-4715-85f3-8f081318fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc27586-8bee-4715-85f3-8f081318fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1768190070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccdfd22-9da5-4858-b2f5-f6f948fc465d,host='devstack@QuobyteHD#QuobyteHD',id=bac6b0b1-0910-4434-9225-1b58bbb8a536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9f49b309e439aadfb6d7b8e0f44a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:59Z,use_quota=True,user_id='e5cb742cf5dc43758c79fae83a040750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43),volume_type_id=db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d93a064-c7ea-4af1-a8d5-c8528d510001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d93a064-c7ea-4af1-a8d5-c8528d510001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095e8981-5398-45c2-a7f5-ba637c14eec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095e8981-5398-45c2-a7f5-ba637c14eec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bac6b0b1-0910-4434-9225-1b58bbb8a536', 'volume_name': 'volume-bac6b0b1-0910-4434-9225-1b58bbb8a536', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7eb339-02c7-4d6e-b72f-e3410f4ba707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7eb339-02c7-4d6e-b72f-e3410f4ba707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7902eba-1f0f-4567-8f56-f5a496293fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:30:59 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Volume bac6b0b1-0910-4434-9225-1b58bbb8a536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bac6b0b1-0910-4434-9225-1b58bbb8a536', 'volume_size': 1} Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:30:59 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info" returned: 0 in 0.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:30:59 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info is being set with open permissions: ugo+rw Jul 06 15:30:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:30:59 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info Jul 06 15:30:59 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:00 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.info" returned: 0 in 0.644s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.157s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.945s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ccdfd22-9da5-4858-b2f5-f6f948fc465d,created_at=2026-07-06T13:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1768190070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccdfd22-9da5-4858-b2f5-f6f948fc465d,host='devstack@QuobyteHD#QuobyteHD',id=bac6b0b1-0910-4434-9225-1b58bbb8a536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9f49b309e439aadfb6d7b8e0f44a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:30:59Z,use_quota=True,user_id='e5cb742cf5dc43758c79fae83a040750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43),volume_type_id=db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Creating volume bac6b0b1-0910-4434-9225-1b58bbb8a536 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:00 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:00 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 1073741824 Jul 06 15:31:00 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-3589684a-489e-42c1-a705-8a69e3cad9c8 req-a71bae75-5d5d-48bd-82ff-198b1e616aa7 tempest-VolumesSnapshotsTestJSON-445486857 None] Create snapshot completed successfully Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "cinder-3954b6a5-98c0-41f2-924a-9afe69213fd0-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-3954b6a5-98c0-41f2-924a-9afe69213fd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "cinder-quobyte-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-quobyte-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "cinder-quobyte-3954b6a5-98c0-41f2-924a-9afe69213fd0" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-quobyte-3954b6a5-98c0-41f2-924a-9afe69213fd0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Deleting offline snapshot 3954b6a5-98c0-41f2-924a-9afe69213fd0 of volume ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] snapshot_file for this snap is: volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[97530642-5cfd-48eb-a862-b301bfc717a8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:01 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 Jul 06 15:31:01 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:01 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 1073741824" returned: 0 in 1.013s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:01 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 Jul 06 15:31:01 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:01 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0" returned: 0 in 0.864s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b1453a-bba9-4d52-8fda-c1222a20659d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:02 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 Jul 06 15:31:02 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:02 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7902eba-1f0f-4567-8f56-f5a496293fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac6b0b1-0910-4434-9225-1b58bbb8a536', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adcb0aa-50b4-49e3-848c-b7432227f7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Volume volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 (bac6b0b1-0910-4434-9225-1b58bbb8a536): created successfully Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3adcb0aa-50b4-49e3-848c-b7432227f7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Flow 'volume_create_manager' (90658756-c1fb-4d20-a24f-6cf74624db20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fea48a03-7a93-4d50-b4f5-ae8574037293 tempest-GroupsTest-1395743444 None] Created volume successfully. Jul 06 15:31:02 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" returned: 0 in 0.926s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:02 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 Jul 06 15:31:02 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Flow 'volume_create_manager' (9f355b95-6555-4773-a6ee-2931d0a3386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2cb343-1980-455f-89ad-7c9e248aa177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2cb343-1980-455f-89ad-7c9e248aa177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320923010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccdfd22-9da5-4858-b2f5-f6f948fc465d,host='devstack@QuobyteHD#QuobyteHD',id=db8a9bea-d2c5-4957-b391-12c41e6ffaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9f49b309e439aadfb6d7b8e0f44a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:04Z,use_quota=True,user_id='e5cb742cf5dc43758c79fae83a040750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43),volume_type_id=db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e02f6e-845a-450c-a970-63528f39161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e02f6e-845a-450c-a970-63528f39161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1b210a-897c-455c-8179-606fad295ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1b210a-897c-455c-8179-606fad295ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db8a9bea-d2c5-4957-b391-12c41e6ffaff', 'volume_name': 'volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b41361d-6616-4040-bb80-b99927b53474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b41361d-6616-4040-bb80-b99927b53474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e481db-a8f5-4739-8675-21b957c1e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Volume db8a9bea-d2c5-4957-b391-12c41e6ffaff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff', 'volume_size': 1} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0ccdfd22-9da5-4858-b2f5-f6f948fc465d,created_at=2026-07-06T13:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-320923010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0ccdfd22-9da5-4858-b2f5-f6f948fc465d,host='devstack@QuobyteHD#QuobyteHD',id=db8a9bea-d2c5-4957-b391-12c41e6ffaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f9f49b309e439aadfb6d7b8e0f44a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:04Z,use_quota=True,user_id='e5cb742cf5dc43758c79fae83a040750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43),volume_type_id=db184ac7-3a1e-47d8-a6d9-6c2f63a4ae43)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Creating volume db8a9bea-d2c5-4957-b391-12c41e6ffaff {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:03 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff 1073741824 Jul 06 15:31:03 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:03 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0" returned: 0 in 1.012s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:03 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0 Jul 06 15:31:03 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:04 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642.3954b6a5-98c0-41f2-924a-9afe69213fd0" returned: 0 in 0.752s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-quobyte-3954b6a5-98c0-41f2-924a-9afe69213fd0" released by "_delete_snapshot" :: held 3.674s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-quobyte-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" released by "delete_snapshot" :: held 3.709s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:04 devstack cinder-volume[86191]: WARNING cinder.quota [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:31:04 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff 1073741824" returned: 0 in 0.988s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG cinder.quota [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Created reservations ['1c815645-3d8d-4b32-b41a-944cbac1b323', '8612cfcb-32cd-4d59-ad2c-13331b2a10d6', '7398c3e0-6f4b-4cf6-b8c7-6c808886c2a7', '8e360a53-c15a-4cc9-9b12-ca9e8afa4308'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:04 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff Jul 06 15:31:04 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Delete snapshot completed successfully. Jul 06 15:31:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7c3d53f9-c391-4257-bf04-c225f3343989 req-b8e8e6c6-bcd6-4999-a77a-3131d214f76f tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-3954b6a5-98c0-41f2-924a-9afe69213fd0-delete_snapshot" released by "delete_snapshot" :: held 3.898s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "cinder-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "cinder-quobyte-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-quobyte-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:05 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6e481db-a8f5-4739-8675-21b957c1e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151e118f-c40d-47cd-8338-e9a478c91e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f9e0e-887f-4636-9e78-9f41a3f5106f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:05 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Volume volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff (db8a9bea-d2c5-4957-b391-12c41e6ffaff): created successfully Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (151e118f-c40d-47cd-8338-e9a478c91e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Flow 'volume_create_manager' (9f355b95-6555-4773-a6ee-2931d0a3386b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c6931689-490f-46d3-a2ff-e289461c6a49 tempest-GroupsTest-1395743444 None] Created volume successfully. Jul 06 15:31:05 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 Jul 06 15:31:05 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-be02c048-1e1e-4ea9-8e4f-f75e9baa84ee tempest-GroupsTest-1395743444 None] Update group completed successfully. Jul 06 15:31:06 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" returned: 0 in 0.897s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:06 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642 Jul 06 15:31:06 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:06 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:31:06 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:07 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" returned: 0 in 0.701s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-quobyte-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642" released by "delete_volume" :: held 1.682s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.quota [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Created reservations ['ba0a2c51-0805-4504-b08d-f162813c5ff1', '2a882051-849d-414a-afa8-e9748cb3b5b3', '3fb61131-3d92-405f-acf9-8f6dc2f7b3fe', '9b9081e1-3ea6-4015-a3a0-104d35a6e052'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:07 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:31:07 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:07 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.875s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 8 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:31:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:31:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-325d3fa4-10a1-4d6d-99a7-cb8068bbfe6f tempest-GroupsTest-1395743444 None] Update group completed successfully. Jul 06 15:31:08 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.855s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.manager [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Deleted volume successfully. Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-ce0fcb93-4557-4ffc-bf97-0a21d36ef39b req-df11e3f2-c77d-467f-983d-0f29b7ee7ecc tempest-VolumesSnapshotsTestJSON-445486857 None] Lock "cinder-ef2816d3-8dd0-4d6a-b37f-bcf2e63b9642-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Flow 'volume_create_manager' (09696134-e818-452f-8fa1-20e94e99d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545dc78a-67ca-4170-92a1-dc3f83876b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (545dc78a-67ca-4170-92a1-dc3f83876b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-811363466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f38bdbe-a9ba-4f9f-a34d-8921276a4963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823835d53e64686960bb26fee66ea18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:08Z,use_quota=True,user_id='64367fa464b04dafaf8b42099c6a17a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d84456-b81f-4a42-bf71-cfd7544e50d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d84456-b81f-4a42-bf71-cfd7544e50d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbb7614-1c7a-424d-a194-0c75bc643a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbb7614-1c7a-424d-a194-0c75bc643a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f38bdbe-a9ba-4f9f-a34d-8921276a4963', 'volume_name': 'volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f1f0d5-98c9-4547-8444-d6e7140854a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f1f0d5-98c9-4547-8444-d6e7140854a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70838837-0d52-4ec6-9637-742374574a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Volume 8f38bdbe-a9ba-4f9f-a34d-8921276a4963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963', 'volume_size': 1} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-811363466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f38bdbe-a9ba-4f9f-a34d-8921276a4963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4823835d53e64686960bb26fee66ea18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:08Z,use_quota=True,user_id='64367fa464b04dafaf8b42099c6a17a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Creating volume 8f38bdbe-a9ba-4f9f-a34d-8921276a4963 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:08 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:31:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:08 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 1073741824 Jul 06 15:31:08 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:09 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 1073741824" returned: 0 in 1.016s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:09 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 Jul 06 15:31:09 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Acquiring lock "cinder-quobyte-bac6b0b1-0910-4434-9225-1b58bbb8a536" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Lock "cinder-quobyte-bac6b0b1-0910-4434-9225-1b58bbb8a536" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[372ca0fb-6142-46c8-8050-dbc2147fdf03]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:09 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 Jul 06 15:31:09 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:10 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963" returned: 0 in 1.039s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70838837-0d52-4ec6-9637-742374574a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ded6ad-b9e6-4c04-85a1-83278f734fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:10 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Volume volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 (8f38bdbe-a9ba-4f9f-a34d-8921276a4963): created successfully Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ded6ad-b9e6-4c04-85a1-83278f734fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Flow 'volume_create_manager' (09696134-e818-452f-8fa1-20e94e99d36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3228f572-c577-446c-b495-8ea5b7eed06e tempest-AttachVolumeShelveTestJSON-117391091 None] Created volume successfully. Jul 06 15:31:10 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536" returned: 0 in 1.206s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:10 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536 Jul 06 15:31:10 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:11 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bac6b0b1-0910-4434-9225-1b58bbb8a536" returned: 0 in 1.082s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Lock "cinder-quobyte-bac6b0b1-0910-4434-9225-1b58bbb8a536" released by "delete_volume" :: held 2.356s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Acquiring lock "cinder-quobyte-db8a9bea-d2c5-4957-b391-12c41e6ffaff" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Lock "cinder-quobyte-db8a9bea-d2c5-4957-b391-12c41e6ffaff" acquired by "delete_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:12 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22327e6-a332-410b-b7c2-2eb3cc2d5d2b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:12 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff Jul 06 15:31:12 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Flow 'volume_create_manager' (086bb445-3602-4ae4-b13d-40a61b13421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efccbc9-8a64-4e68-85f7-6f3fb9aabf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efccbc9-8a64-4e68-85f7-6f3fb9aabf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-473080951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ed34fc-3444-4ce0-ba34-06aa22e31776,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e7423505d3e4c9eafea0cebc37f3da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:13Z,use_quota=True,user_id='1f00222709824b1e822abbfc59adbe41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d3f621-6295-4928-8b51-ce183753583f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:13 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d3f621-6295-4928-8b51-ce183753583f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc43f276-3389-4281-b45e-9173bd664b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc43f276-3389-4281-b45e-9173bd664b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ed34fc-3444-4ce0-ba34-06aa22e31776', 'volume_name': 'volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0fa2f3-8ebb-4720-90d4-7dcd15bccf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0fa2f3-8ebb-4720-90d4-7dcd15bccf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca4037f-f211-449f-88b8-480855128293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:13 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Volume a1ed34fc-3444-4ce0-ba34-06aa22e31776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776', 'volume_size': 1} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-473080951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ed34fc-3444-4ce0-ba34-06aa22e31776,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e7423505d3e4c9eafea0cebc37f3da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:13Z,use_quota=True,user_id='1f00222709824b1e822abbfc59adbe41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Creating volume a1ed34fc-3444-4ce0-ba34-06aa22e31776 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:13 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff" returned: 0 in 1.134s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:13 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 1073741824 Jul 06 15:31:13 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:13 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff Jul 06 15:31:13 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:13 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-db8a9bea-d2c5-4957-b391-12c41e6ffaff" returned: 0 in 0.764s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Lock "cinder-quobyte-db8a9bea-d2c5-4957-b391-12c41e6ffaff" released by "delete_volume" :: held 1.952s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Created reservations ['2d7f3a2b-ed43-486e-9e4c-06152f0aac23'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:14 devstack cinder-volume[86191]: WARNING cinder.quota [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-779340135 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-779340135, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:31:14 devstack cinder-volume[86191]: WARNING cinder.quota [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-779340135 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-779340135, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Created reservations ['3b9b4841-185a-4bd2-a6ca-20215caa1a95', '02bff489-0572-410a-b755-f8e06d03fc27', '83cfeff6-8a9c-4f95-a8da-fd31b255afa3', '82a3243e-200a-4e89-a63b-bdb24c22070f'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:14 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Created reservations ['fdbbcba0-944e-4664-91c4-551a1a2c15f5', 'e973ec44-ad3d-4e18-9b3c-823a325a8a3c', 'd759840e-c82b-459f-afb5-294d6328f44a', '3de2ff05-408d-4fce-814e-1378b633892e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 1073741824" returned: 0 in 1.049s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:14 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 Jul 06 15:31:14 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:14 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:31:14 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:15 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776" returned: 0 in 0.755s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca4037f-f211-449f-88b8-480855128293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:15 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a77259-6cb6-4a6e-a106-1128d7f039d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.676s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:15 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Volume volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 (a1ed34fc-3444-4ce0-ba34-06aa22e31776): created successfully Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25a77259-6cb6-4a6e-a106-1128d7f039d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Flow 'volume_create_manager' (086bb445-3602-4ae4-b13d-40a61b13421c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f2ee0f61-3802-416c-bbf4-c5ed8f69647e tempest-GroupsTest-1395743444 None] Delete group completed successfully. Jul 06 15:31:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-a3382d67-cf49-4563-b75b-0882b7da2e69 req-eab36629-688e-4dbc-a41e-afca36880ed5 tempest-VolumesGetTestJSON-1852292541 None] Created volume successfully. Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Acquiring lock "cinder-a1ed34fc-3444-4ce0-ba34-06aa22e31776-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Lock "cinder-a1ed34fc-3444-4ce0-ba34-06aa22e31776-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Acquiring lock "cinder-quobyte-a1ed34fc-3444-4ce0-ba34-06aa22e31776" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Lock "cinder-quobyte-a1ed34fc-3444-4ce0-ba34-06aa22e31776" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8e3af2-64b5-4fe3-ac2b-3f5e464b278c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:16 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 Jul 06 15:31:16 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:16 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:16 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776 Jul 06 15:31:16 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:17 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a1ed34fc-3444-4ce0-ba34-06aa22e31776" returned: 0 in 1.047s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Lock "cinder-quobyte-a1ed34fc-3444-4ce0-ba34-06aa22e31776" released by "delete_volume" :: held 1.975s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG cinder.quota [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Created reservations ['f9b250c9-cfb3-48d3-ac61-00bb8ce39ffc', '1fe8848f-bda5-4a42-8f7f-3fb3450ee358', 'a3f6d35b-da70-4caf-94bb-3bcb8c24d06f', 'e918e981-6d90-4d94-9c80-d91382198d92'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:18 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:31:18 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:19 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.198s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:19 devstack cinder-volume[86191]: DEBUG cinder.manager [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Deleted volume successfully. Jul 06 15:31:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-7d26c1dd-3885-46ec-b76d-c27faf2f9860 req-8faabc54-ffe1-4b7d-b9c6-20504323aafb tempest-VolumesGetTestJSON-1852292541 None] Lock "cinder-a1ed34fc-3444-4ce0-ba34-06aa22e31776-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:24 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:INSERT=29,cinder:UPDATE=120,cinder:SELECT=98,cinder:DELETE=5 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fd76f189-c6dd-4d6d-8e9f-6cd787279006 tempest-GroupsV314Test-702434221 None] Group tempest-GroupsV314Test-Group-1846206544: creating Jul 06 15:31:24 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=98,cinder:INSERT=26,cinder:UPDATE=124,cinder:DELETE=10 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fd76f189-c6dd-4d6d-8e9f-6cd787279006 tempest-GroupsV314Test-702434221 None] Group tempest-GroupsV314Test-Group-1846206544: created successfully Jul 06 15:31:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fd76f189-c6dd-4d6d-8e9f-6cd787279006 tempest-GroupsV314Test-702434221 None] Create group completed successfully. Jul 06 15:31:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b2009cd0-6f50-4067-a85a-a1744c1f4bea tempest-GroupSnapshotsV319Test-154324536 None] Group tempest-GroupSnapshotsV319Test-Group-2130429567: creating Jul 06 15:31:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b2009cd0-6f50-4067-a85a-a1744c1f4bea tempest-GroupSnapshotsV319Test-154324536 None] Group tempest-GroupSnapshotsV319Test-Group-2130429567: created successfully Jul 06 15:31:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b2009cd0-6f50-4067-a85a-a1744c1f4bea tempest-GroupSnapshotsV319Test-154324536 None] Create group completed successfully. Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Flow 'volume_create_manager' (82cae1d2-875e-4525-8721-641e98361cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f57a9-0d5b-473e-98f1-7e70788e5cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571f57a9-0d5b-473e-98f1-7e70788e5cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343616941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e3de433-c2b6-434b-8f15-4cd1468f31f4,host='devstack@QuobyteHD#QuobyteHD',id=3966795d-9641-4c96-ac5f-dc6f178505b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e5f3c7f5c4fed82ab0cf72f29e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:26Z,use_quota=True,user_id='58aba80768d84179a7780bebf4176e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65a50e9f-a745-4ec6-a141-2d0982c42d22),volume_type_id=65a50e9f-a745-4ec6-a141-2d0982c42d22)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8e553f-f9cc-4ac3-84e8-a718acbde40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8e553f-f9cc-4ac3-84e8-a718acbde40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc3a5e9-794b-447e-9a79-e837eb2b88a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc3a5e9-794b-447e-9a79-e837eb2b88a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3966795d-9641-4c96-ac5f-dc6f178505b3', 'volume_name': 'volume-3966795d-9641-4c96-ac5f-dc6f178505b3', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730a7585-4470-4a1d-ae61-696cd9fa3b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (730a7585-4470-4a1d-ae61-696cd9fa3b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be03b52c-3877-4c8c-aa6b-a4d82e7007f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:26 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Volume 3966795d-9641-4c96-ac5f-dc6f178505b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3966795d-9641-4c96-ac5f-dc6f178505b3', 'volume_size': 1} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9e3de433-c2b6-434b-8f15-4cd1468f31f4,created_at=2026-07-06T13:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-343616941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9e3de433-c2b6-434b-8f15-4cd1468f31f4,host='devstack@QuobyteHD#QuobyteHD',id=3966795d-9641-4c96-ac5f-dc6f178505b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e5f3c7f5c4fed82ab0cf72f29e8f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:26Z,use_quota=True,user_id='58aba80768d84179a7780bebf4176e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65a50e9f-a745-4ec6-a141-2d0982c42d22),volume_type_id=65a50e9f-a745-4ec6-a141-2d0982c42d22)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Creating volume 3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:26 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:31:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:26 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 1073741824 Jul 06 15:31:26 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:27 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 1073741824" returned: 0 in 1.217s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:31:27 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:27 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Flow 'volume_create_manager' (c48b940e-07ca-48df-bcfb-f189007f40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5504f31a-b55c-4449-8e4b-3057ebf267f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5504f31a-b55c-4449-8e4b-3057ebf267f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-931142919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=292aa333-96f3-4125-8e09-fbf9f9bbbe14,host='devstack@QuobyteHD#QuobyteHD',id=275c2848-3c3f-40b9-b34a-f84d805965eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7628108c60b4c5ab529f50b16fa34ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:27Z,use_quota=True,user_id='dd9a23d1c2254d9a976771795ab2ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(355bfd65-a5e8-4122-882e-94ef3e17fbd3),volume_type_id=355bfd65-a5e8-4122-882e-94ef3e17fbd3)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce109f5-c1c1-407a-95de-e38bc1403479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce109f5-c1c1-407a-95de-e38bc1403479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131ba0ca-b0ea-49e8-adc0-742207467bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (131ba0ca-b0ea-49e8-adc0-742207467bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '275c2848-3c3f-40b9-b34a-f84d805965eb', 'volume_name': 'volume-275c2848-3c3f-40b9-b34a-f84d805965eb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b68beef-fff5-4a67-a06c-36fad82cfc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b68beef-fff5-4a67-a06c-36fad82cfc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e30ac9-1984-4e9d-92dc-e4db9d823ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Volume 275c2848-3c3f-40b9-b34a-f84d805965eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-275c2848-3c3f-40b9-b34a-f84d805965eb', 'volume_size': 1} Jul 06 15:31:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:28 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 0.903s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=292aa333-96f3-4125-8e09-fbf9f9bbbe14,created_at=2026-07-06T13:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-931142919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=292aa333-96f3-4125-8e09-fbf9f9bbbe14,host='devstack@QuobyteHD#QuobyteHD',id=275c2848-3c3f-40b9-b34a-f84d805965eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7628108c60b4c5ab529f50b16fa34ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:31:27Z,use_quota=True,user_id='dd9a23d1c2254d9a976771795ab2ee3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(355bfd65-a5e8-4122-882e-94ef3e17fbd3),volume_type_id=355bfd65-a5e8-4122-882e-94ef3e17fbd3)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Creating volume 275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:31:28 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:28 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb 1073741824 Jul 06 15:31:28 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be03b52c-3877-4c8c-aa6b-a4d82e7007f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3966795d-9641-4c96-ac5f-dc6f178505b3', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34edaa94-1566-479f-80d2-060c190dee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Volume volume-3966795d-9641-4c96-ac5f-dc6f178505b3 (3966795d-9641-4c96-ac5f-dc6f178505b3): created successfully Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34edaa94-1566-479f-80d2-060c190dee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Flow 'volume_create_manager' (82cae1d2-875e-4525-8721-641e98361cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-343f85ba-443d-4361-8f3d-eb4d539ce323 tempest-GroupsV314Test-702434221 None] Created volume successfully. Jul 06 15:31:29 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb 1073741824" returned: 0 in 1.197s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:29 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb Jul 06 15:31:29 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:30 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e30ac9-1984-4e9d-92dc-e4db9d823ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-275c2848-3c3f-40b9-b34a-f84d805965eb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda4af71-cc27-4341-bda9-990d06068c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:31:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Volume volume-275c2848-3c3f-40b9-b34a-f84d805965eb (275c2848-3c3f-40b9-b34a-f84d805965eb): created successfully Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda4af71-cc27-4341-bda9-990d06068c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:31:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Flow 'volume_create_manager' (c48b940e-07ca-48df-bcfb-f189007f40e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:31:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9bba68cf-ac96-40af-b812-15f55d0ecff8 tempest-GroupSnapshotsV319Test-154324536 None] Created volume successfully. Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:31 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Cloning volume 3966795d-9641-4c96-ac5f-dc6f178505b3 to volume d61ee359-00e4-40d1-8fe9-41be0767d5b8 Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Creating offline snapshot 26941b4b-8af5-4faa-b1e2-1637f45df850 of volume 3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0714590-4c4e-4360-a76b-3c7e696ae050]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:31 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:31 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] GroupSnapshot b6deb4b2-bcee-403f-bb8b-2dc3b7099887: creating. Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Group snapshot b6deb4b2-bcee-403f-bb8b-2dc3b7099887: creating. {{(pid=86191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:31:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-61ced327-820d-4ff4-8924-ef8d65935114 req-02d7e809-49b2-4fce-ba27-55966e590f27 tempest-AttachVolumeShelveTestJSON-117391091 None] No connector for attachment f1ee186f-2027-4c89-b57d-905617a80eae; skipping storage backend terminate_connection call. {{(pid=86191) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 15:31:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-61ced327-820d-4ff4-8924-ef8d65935114 req-02d7e809-49b2-4fce-ba27-55966e590f27 tempest-AttachVolumeShelveTestJSON-117391091 None] Deleting attachment f1ee186f-2027-4c89-b57d-905617a80eae. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:31:32 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:32 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 1G Jul 06 15:31:32 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:33 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 1G" returned: 0 in 0.902s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966795d-9641-4c96-ac5f-dc6f178505b3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:33 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966795d-9641-4c96-ac5f-dc6f178505b3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 Jul 06 15:31:33 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:33 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3966795d-9641-4c96-ac5f-dc6f178505b3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850" returned: 0 in 0.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:33 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:31:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:33 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 Jul 06 15:31:33 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:34 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850" returned: 0 in 0.695s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:34 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info Jul 06 15:31:34 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:35 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info" returned: 0 in 0.666s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:35 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:35 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info Jul 06 15:31:35 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:35 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.info" returned: 0 in 0.715s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Acquiring lock "cinder-quobyte-d61ee359-00e4-40d1-8fe9-41be0767d5b8" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-d61ee359-00e4-40d1-8fe9-41be0767d5b8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] snapshot: 26941b4b-8af5-4faa-b1e2-1637f45df850, volume: d61ee359-00e4-40d1-8fe9-41be0767d5b8, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11805c6-f927-45da-8099-30b49aac0f61]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:36 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 Jul 06 15:31:36 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:36 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850" returned: 0 in 0.814s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966795d-9641-4c96-ac5f-dc6f178505b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:31:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:31:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:31:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ab98a5-fe91-4301-9ef0-e135bfdc7463]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:36 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:36 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:37 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 0.876s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:37 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:31:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:37 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 Jul 06 15:31:37 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:43 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8" returned: 0 in 5.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2b0131-1cb9-412e-b318-7cb75ca6d474]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:43 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:43 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:44 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 0.930s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:44 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:31:44 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Converted 1024.00 MB image at 177.18 MB/s Jul 06 15:31:44 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:31:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:44 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 Jul 06 15:31:44 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:44 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=11,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:44 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=6,cinder:SELECT=17,cinder:INSERT=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:31:45 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8" returned: 0 in 0.886s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-d61ee359-00e4-40d1-8fe9-41be0767d5b8" released by "_copy_volume_from_snapshot" :: held 9.372s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Acquiring lock "cinder-quobyte-26941b4b-8af5-4faa-b1e2-1637f45df850" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-26941b4b-8af5-4faa-b1e2-1637f45df850" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Deleting offline snapshot 26941b4b-8af5-4faa-b1e2-1637f45df850 of volume 3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] snapshot_file for this snap is: volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc553f4-e05b-4d4d-a643-58814abac4f1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:45 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 Jul 06 15:31:45 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:46 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850" returned: 0 in 1.197s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3966795d-9641-4c96-ac5f-dc6f178505b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:31:46 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b227f-06a7-43b6-b668-b7196d7913cf]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:46 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:46 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:47 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 0.900s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:47 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 Jul 06 15:31:47 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:48 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850" returned: 0 in 0.755s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:48 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850 Jul 06 15:31:48 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:49 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3.26941b4b-8af5-4faa-b1e2-1637f45df850" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-26941b4b-8af5-4faa-b1e2-1637f45df850" released by "_delete_snapshot" :: held 3.745s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.149s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.413s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Creating offline snapshot cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 of volume 275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda94806-2f66-4db7-9d98-9357353ae776]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:49 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb Jul 06 15:31:49 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4b906b47-e750-4944-8bfc-b498b5576978 tempest-GroupsV314Test-702434221 None] Create group from source-group-9e3de433-c2b6-434b-8f15-4cd1468f31f4 completed successfully. Jul 06 15:31:50 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:50 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 1G Jul 06 15:31:50 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Acquiring lock "cinder-quobyte-d61ee359-00e4-40d1-8fe9-41be0767d5b8" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-d61ee359-00e4-40d1-8fe9-41be0767d5b8" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94689f2-a029-417f-98bd-081620cff8a2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:50 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 Jul 06 15:31:50 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:50 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 1G" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-275c2848-3c3f-40b9-b34a-f84d805965eb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:50 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-275c2848-3c3f-40b9-b34a-f84d805965eb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 Jul 06 15:31:50 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:51 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8" returned: 0 in 1.105s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:51 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8 Jul 06 15:31:51 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:52 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-275c2848-3c3f-40b9-b34a-f84d805965eb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" returned: 0 in 1.240s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:52 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:52 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 Jul 06 15:31:52 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:52 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d61ee359-00e4-40d1-8fe9-41be0767d5b8" returned: 0 in 0.805s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-d61ee359-00e4-40d1-8fe9-41be0767d5b8" released by "delete_volume" :: held 1.965s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Created reservations ['5cb02ff2-8785-4aaf-9cd2-436520eacfc7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:52 devstack cinder-volume[86191]: WARNING cinder.quota [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1348705733 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1348705733, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:31:52 devstack cinder-volume[86191]: WARNING cinder.quota [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1348705733 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1348705733, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Created reservations ['06a0923f-46df-4593-87b1-7355f62f8030', '135c6b84-30c6-41c9-b179-bf59e453d183', '3d088b65-7266-43b3-9572-458a933db496', '57a31ac3-0920-4d56-b1f8-faf45e08d432'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:52 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:53 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:31:53 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:53 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info Jul 06 15:31:53 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Acquiring lock "cinder-quobyte-3966795d-9641-4c96-ac5f-dc6f178505b3" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-3966795d-9641-4c96-ac5f-dc6f178505b3" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2f262c-a025-4c51-8914-72182fdbfeb9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:53 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:53 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:53 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.036s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:54 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1d21225b-86f6-43d2-b61b-763863c67130 tempest-GroupsV314Test-702434221 None] Delete group completed successfully. Jul 06 15:31:54 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info" returned: 0 in 1.080s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:54 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:31:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:54 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info Jul 06 15:31:54 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:54 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 1.199s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:54 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3 Jul 06 15:31:54 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:55 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.info" returned: 0 in 1.026s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.887s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ea5ca9fc-2ea5-4f3e-a519-5e397af71e5a tempest-GroupSnapshotsV319Test-154324536 None] group_snapshot b6deb4b2-bcee-403f-bb8b-2dc3b7099887: created successfully Jul 06 15:31:55 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3966795d-9641-4c96-ac5f-dc6f178505b3" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Lock "cinder-quobyte-3966795d-9641-4c96-ac5f-dc6f178505b3" released by "delete_volume" :: held 2.037s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Created reservations ['60e22bc0-4c3d-43f1-a703-215050257ae5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Created reservations ['018ac0f2-1f99-466d-bf59-dc3e3994607c', '46738502-a8fa-4d38-86c3-94fefe8edfea', '30f9f34d-ac6c-4cf7-9bfa-935472865a44', 'ed3c8eaa-2e4c-4cf7-bd43-33ceb542ab0b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:31:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:55 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:31:55 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:56 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.694s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:31:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-444eb58c-16b9-47b2-9946-032479b64709 tempest-GroupsV314Test-702434221 None] Delete group completed successfully. Jul 06 15:31:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] group_snapshot b6deb4b2-bcee-403f-bb8b-2dc3b7099887: deleting Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] group_snapshot b6deb4b2-bcee-403f-bb8b-2dc3b7099887: deleting {{(pid=86191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "cinder-quobyte-275c2848-3c3f-40b9-b34a-f84d805965eb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-eb0dfb2e-f17f-44ac-908b-43ab2b629035 req-3646f366-b80c-4368-8688-0c5589096f5d tempest-AttachVolumeNegativeTest-2045782107 None] Terminate volume connection completed successfully. Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-eb0dfb2e-f17f-44ac-908b-43ab2b629035 req-3646f366-b80c-4368-8688-0c5589096f5d tempest-AttachVolumeNegativeTest-2045782107 None] Deleting attachment d66ed56f-152d-4ad9-a59c-185424f13dec. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Lock "cinder-quobyte-275c2848-3c3f-40b9-b34a-f84d805965eb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "cinder-quobyte-cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Lock "cinder-quobyte-cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Deleting offline snapshot cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 of volume 275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:31:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] snapshot_file for this snap is: volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:31:57 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943265c-3899-45c8-a29f-110e15f90013]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:57 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 Jul 06 15:31:57 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:57 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" returned: 0 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-275c2848-3c3f-40b9-b34a-f84d805965eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:31:57 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a81e24-17fe-4f09-a2d4-4c4dcc1f3b45]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:31:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:58 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb Jul 06 15:31:58 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:31:59 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 06 15:31:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb" returned: 0 in 1.090s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:31:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:31:59 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 Jul 06 15:31:59 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:00 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" returned: 0 in 1.058s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:00 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6 Jul 06 15:32:00 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:01 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb.cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" returned: 0 in 1.150s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Lock "cinder-quobyte-cd231bf7-6c6e-4c9a-9271-e15c9dbf1af6" released by "_delete_snapshot" :: held 4.404s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Lock "cinder-quobyte-275c2848-3c3f-40b9-b34a-f84d805965eb" released by "delete_snapshot" :: held 4.474s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:01 devstack cinder-volume[86191]: WARNING cinder.quota [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-38514171 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-38514171, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:01 devstack cinder-volume[86191]: WARNING cinder.quota [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-38514171 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-38514171, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:01 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] Created reservations ['610bed50-a3be-407f-bd37-fa7cb4ef83bb', '108a2e5b-ed34-44b6-ade1-e8dc8faf8eed', '9a6ce808-a17d-468c-9bed-8495f51301de', '0284fd72-e3d9-47ce-9dd7-bcc25310511d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bc346b9e-b70c-41f3-be20-90f4bccdcb51 tempest-GroupSnapshotsV319Test-154324536 None] group_snapshot b6deb4b2-bcee-403f-bb8b-2dc3b7099887: deleted successfully Jul 06 15:32:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "cinder-quobyte-275c2848-3c3f-40b9-b34a-f84d805965eb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Lock "cinder-quobyte-275c2848-3c3f-40b9-b34a-f84d805965eb" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:02 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8052bee7-4a3e-4ba8-8de9-6f532cc32308]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:03 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb Jul 06 15:32:03 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:03 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb" returned: 0 in 0.882s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:03 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb Jul 06 15:32:03 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Flow 'volume_create_manager' (9c24f320-a629-4e39-9064-e670399b2c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2513be43-7aa1-42dd-91d4-8005f05c2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2513be43-7aa1-42dd-91d4-8005f05c2b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-967925869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f322e78-7629-41a2-a277-57b578f34f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5545acdda8d4eec9d8bdf6a59db8bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:04Z,use_quota=True,user_id='190ea60a27714c908b652dd6130d5147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10410055-84c5-445c-80e8-0bbaf5a543b5),volume_type_id=10410055-84c5-445c-80e8-0bbaf5a543b5)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:04 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7841af45-bfe5-4ef9-9461-b6f7989a5439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7841af45-bfe5-4ef9-9461-b6f7989a5439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5428142-1602-416d-aa17-ff1bc7cef2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5428142-1602-416d-aa17-ff1bc7cef2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f322e78-7629-41a2-a277-57b578f34f26', 'volume_name': 'volume-5f322e78-7629-41a2-a277-57b578f34f26', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdd100b-b547-4de0-8afb-4a46fcefa6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdd100b-b547-4de0-8afb-4a46fcefa6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773c6964-1679-49f8-956b-df73fa099bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Volume 5f322e78-7629-41a2-a277-57b578f34f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f322e78-7629-41a2-a277-57b578f34f26', 'volume_size': 1} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-967925869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f322e78-7629-41a2-a277-57b578f34f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5545acdda8d4eec9d8bdf6a59db8bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:04Z,use_quota=True,user_id='190ea60a27714c908b652dd6130d5147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10410055-84c5-445c-80e8-0bbaf5a543b5),volume_type_id=10410055-84c5-445c-80e8-0bbaf5a543b5)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Creating volume 5f322e78-7629-41a2-a277-57b578f34f26 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:04 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-275c2848-3c3f-40b9-b34a-f84d805965eb" returned: 0 in 0.772s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:04 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 1073741824 Jul 06 15:32:04 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Lock "cinder-quobyte-275c2848-3c3f-40b9-b34a-f84d805965eb" released by "delete_volume" :: held 1.726s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Created reservations ['518d72d7-0f3c-4776-bc6c-6a034ec75cc8'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:04 devstack cinder-volume[86191]: WARNING cinder.quota [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-38514171 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-38514171, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Created reservations ['1ae251e5-edd4-425d-ae46-21e16ed5d45a', '969fafd3-c129-4f20-9252-ad9d68c79375', 'ac0c40f1-855c-4bb4-ae22-5297a524fc03', '053cc306-6c21-41ff-a55f-f3082f129a06'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:04 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:04 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:05 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 1073741824" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:05 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.686s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:05 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:05 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 Jul 06 15:32:05 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c596c77b-eb5f-4623-9c2d-8063181d8c6c tempest-GroupSnapshotsV319Test-154324536 None] Delete group completed successfully. Jul 06 15:32:06 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26" returned: 0 in 0.699s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773c6964-1679-49f8-956b-df73fa099bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f322e78-7629-41a2-a277-57b578f34f26', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3549c638-c039-4516-9c60-cfafcdc1e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Volume volume-5f322e78-7629-41a2-a277-57b578f34f26 (5f322e78-7629-41a2-a277-57b578f34f26): created successfully Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3549c638-c039-4516-9c60-cfafcdc1e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Flow 'volume_create_manager' (9c24f320-a629-4e39-9064-e670399b2c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-02159adc-ea76-49ab-b39b-cd04edf9e455 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Created volume successfully. Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:06 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:06 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:07 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:07 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:07 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.794s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 8 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:32:07 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.814s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ea2d570b-1f30-41dd-b34a-587990e6af39 tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Retype volume completed successfully. Jul 06 15:32:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Acquiring lock "cinder-5f322e78-7629-41a2-a277-57b578f34f26-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "cinder-5f322e78-7629-41a2-a277-57b578f34f26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Acquiring lock "cinder-quobyte-5f322e78-7629-41a2-a277-57b578f34f26" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "cinder-quobyte-5f322e78-7629-41a2-a277-57b578f34f26" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b4bccc-d7ef-49ac-98e5-fc0193699a18]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:08 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 Jul 06 15:32:08 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:09 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26" returned: 0 in 0.918s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:09 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26 Jul 06 15:32:09 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:10 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5f322e78-7629-41a2-a277-57b578f34f26" returned: 0 in 0.735s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "cinder-quobyte-5f322e78-7629-41a2-a277-57b578f34f26" released by "delete_volume" :: held 1.709s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:10 devstack cinder-volume[86191]: WARNING cinder.quota [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:10 devstack cinder-volume[86191]: WARNING cinder.quota [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Created reservations ['34c6a486-8598-410c-9a13-ef1d2999f104', 'c16e79a9-3ae5-44be-9020-23b5ba91e64d', 'd878ffd8-107d-4203-ab5a-8cc0e7bbb03e', 'b471d8d7-fde6-4a88-a4b3-bb0e6e2c818b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:10 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:10 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:11 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.732s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:11 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:11 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Deleted volume successfully. Jul 06 15:32:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e8baf3e-a227-42c4-ac3b-071de292a99c tempest-VolumeRetypeWithoutMigrationTest-1964026851 None] Lock "cinder-5f322e78-7629-41a2-a277-57b578f34f26-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:20 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=58,cinder:SELECT=46,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=60,cinder:SELECT=59,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Flow 'volume_create_manager' (e0886d3b-7979-45fb-850c-156eccff0dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a1e95a-ffdb-4762-86fd-c403ff8117ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a1e95a-ffdb-4762-86fd-c403ff8117ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-409215660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e70d6b-be58-4bbd-a67a-7fd826b99102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31aeae85bee1464389831921fadb67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:22Z,use_quota=True,user_id='cd9e192a9f714dcc8541526ea13f6439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e52804-9583-4fd8-856f-f23cb9335f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e52804-9583-4fd8-856f-f23cb9335f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d491ff-710c-4672-af16-3a689e5d64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d491ff-710c-4672-af16-3a689e5d64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e70d6b-be58-4bbd-a67a-7fd826b99102', 'volume_name': 'volume-04e70d6b-be58-4bbd-a67a-7fd826b99102', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed58e1-4a1a-436e-b247-ac21ac02322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ed58e1-4a1a-436e-b247-ac21ac02322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623ca94-743f-44ab-9842-dd9aae28d1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:21 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Volume 04e70d6b-be58-4bbd-a67a-7fd826b99102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e70d6b-be58-4bbd-a67a-7fd826b99102', 'volume_size': 1} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-409215660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e70d6b-be58-4bbd-a67a-7fd826b99102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31aeae85bee1464389831921fadb67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:22Z,use_quota=True,user_id='cd9e192a9f714dcc8541526ea13f6439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Creating volume 04e70d6b-be58-4bbd-a67a-7fd826b99102 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:21 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:32:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:21 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 1073741824 Jul 06 15:32:21 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:23 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 1073741824" returned: 0 in 1.163s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:23 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 Jul 06 15:32:23 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:24 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102" returned: 0 in 1.052s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623ca94-743f-44ab-9842-dd9aae28d1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e70d6b-be58-4bbd-a67a-7fd826b99102', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b1329e-95b9-4422-9563-e312d550dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Volume volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 (04e70d6b-be58-4bbd-a67a-7fd826b99102): created successfully Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b1329e-95b9-4422-9563-e312d550dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Flow 'volume_create_manager' (e0886d3b-7979-45fb-850c-156eccff0dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b35f9c81-64b9-4797-8f2d-17a495caa035 tempest-VolumeQuotasAdminTestJSON-957771755 None] Created volume successfully. Jul 06 15:32:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "cinder-04e70d6b-be58-4bbd-a67a-7fd826b99102-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "cinder-04e70d6b-be58-4bbd-a67a-7fd826b99102-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "cinder-quobyte-04e70d6b-be58-4bbd-a67a-7fd826b99102" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "cinder-quobyte-04e70d6b-be58-4bbd-a67a-7fd826b99102" acquired by "delete_volume" :: waited 0.043s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c66d47e-09da-4fed-bfde-2c3269655f62]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:25 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 Jul 06 15:32:25 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:26 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102" returned: 0 in 1.377s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:26 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102 Jul 06 15:32:26 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Acquiring lock "cinder-8f38bdbe-a9ba-4f9f-a34d-8921276a4963-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "cinder-8f38bdbe-a9ba-4f9f-a34d-8921276a4963-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Acquiring lock "cinder-quobyte-8f38bdbe-a9ba-4f9f-a34d-8921276a4963" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "cinder-quobyte-8f38bdbe-a9ba-4f9f-a34d-8921276a4963" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[265164f2-05ce-4e34-80ae-79cf9283eaa5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:27 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 Jul 06 15:32:27 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:27 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04e70d6b-be58-4bbd-a67a-7fd826b99102" returned: 0 in 1.092s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "cinder-quobyte-04e70d6b-be58-4bbd-a67a-7fd826b99102" released by "delete_volume" :: held 2.569s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Created reservations ['432da5e0-627f-4c4c-9d7e-4fc61822fed7', '0eafddb4-6ce4-4e20-b625-52a0563d717f', '8af9629e-9cee-43fa-bf01-aef1a7e87e1d', '7181e84f-a734-4be4-8f5b-8f35401db09e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:28 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:28 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:28 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963" returned: 0 in 1.191s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:28 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963 Jul 06 15:32:28 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:29 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.387s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Deleted volume successfully. Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ed09c2e7-4a68-4944-b9a9-6c28353b7cf1 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "cinder-04e70d6b-be58-4bbd-a67a-7fd826b99102-delete_volume" released by "delete_volume" :: held 4.399s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:29 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f38bdbe-a9ba-4f9f-a34d-8921276a4963" returned: 0 in 1.335s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "cinder-quobyte-8f38bdbe-a9ba-4f9f-a34d-8921276a4963" released by "delete_volume" :: held 2.611s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Flow 'volume_create_manager' (f9de0f35-7740-4d93-9610-cc4af969bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac245b65-8e6f-4b21-8ccb-d87d62d784a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac245b65-8e6f-4b21-8ccb-d87d62d784a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1254964967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86f1e0-81c1-487b-b938-bb03fbbcd090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31aeae85bee1464389831921fadb67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:30Z,use_quota=True,user_id='cd9e192a9f714dcc8541526ea13f6439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e904c4d-f16c-4c04-b468-35a9eeab1a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e904c4d-f16c-4c04-b468-35a9eeab1a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d916a52-c62e-42b0-8d86-25674ef2789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d916a52-c62e-42b0-8d86-25674ef2789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b86f1e0-81c1-487b-b938-bb03fbbcd090', 'volume_name': 'volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49212ea2-c955-4edb-a2ee-49295f5c4742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49212ea2-c955-4edb-a2ee-49295f5c4742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74762b16-184a-4137-a22e-ee30f02883da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Volume 2b86f1e0-81c1-487b-b938-bb03fbbcd090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090', 'volume_size': 1} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1254964967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b86f1e0-81c1-487b-b938-bb03fbbcd090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31aeae85bee1464389831921fadb67f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:30Z,use_quota=True,user_id='cd9e192a9f714dcc8541526ea13f6439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Creating volume 2b86f1e0-81c1-487b-b938-bb03fbbcd090 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:29 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:29 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 1073741824 Jul 06 15:32:29 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:29 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Created reservations ['089960a4-615d-49e3-b2ad-fc15efc7e9f3', '805f431e-0a16-43c1-872c-c4a88f527a36', '88798e01-ce47-4e67-b121-61075cd590cd', '71326b81-67a4-4f4a-9674-962e56694247'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:30 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:30 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:31 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.290s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:31 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Deleted volume successfully. Jul 06 15:32:31 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3aefe005-4700-4d8c-a4dc-defb30390265 tempest-AttachVolumeShelveTestJSON-117391091 None] Lock "cinder-8f38bdbe-a9ba-4f9f-a34d-8921276a4963-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 1073741824" returned: 0 in 1.617s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:31 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 Jul 06 15:32:31 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:32 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090" returned: 0 in 1.131s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] <== create_volume: return (2821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.826s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74762b16-184a-4137-a22e-ee30f02883da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261a2ae8-b1a9-4230-ae5c-e3f86d658233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Volume volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 (2b86f1e0-81c1-487b-b938-bb03fbbcd090): created successfully Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261a2ae8-b1a9-4230-ae5c-e3f86d658233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Flow 'volume_create_manager' (f9de0f35-7740-4d93-9610-cc4af969bad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b69eb0f6-258c-430c-83ae-69725bbea558 tempest-VolumeQuotasAdminTestJSON-957771755 None] Created volume successfully. Jul 06 15:32:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0c4bbcc1-aa05-46f8-97f1-3bee01bb8c77 tempest-VolumeQuotasAdminTestJSON-1392816153 None] Transfer volume completed successfully. Jul 06 15:32:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Acquiring lock "cinder-2b86f1e0-81c1-487b-b938-bb03fbbcd090-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Lock "cinder-2b86f1e0-81c1-487b-b938-bb03fbbcd090-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Acquiring lock "cinder-quobyte-2b86f1e0-81c1-487b-b938-bb03fbbcd090" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Lock "cinder-quobyte-2b86f1e0-81c1-487b-b938-bb03fbbcd090" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[61218644-18f1-4551-864a-280b986afaae]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:35 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 Jul 06 15:32:35 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:37 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090" returned: 0 in 1.672s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:37 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090 Jul 06 15:32:37 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:38 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2b86f1e0-81c1-487b-b938-bb03fbbcd090" returned: 0 in 0.952s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Lock "cinder-quobyte-2b86f1e0-81c1-487b-b938-bb03fbbcd090" released by "delete_volume" :: held 2.678s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Created reservations ['70928ae7-336a-4db5-9dad-bcda7a984f5d', 'afbbc5a2-a535-4131-9de8-0d6a26fdfe9f', 'a89b0dbc-04cd-40bd-a372-c77952ea620c', 'd07917ac-1774-4486-9f81-4de3c439ff5b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:38 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:38 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:39 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.970s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:39 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Deleted volume successfully. Jul 06 15:32:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a31c94f2-ea7d-482b-a370-87410016f239 tempest-VolumeQuotasAdminTestJSON-2075529080 None] Lock "cinder-2b86f1e0-81c1-487b-b938-bb03fbbcd090-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:48 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=20,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:32:49 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Flow 'volume_create_manager' (a6864fa8-e727-4c92-b752-a3162155a39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebc4090-79dd-4158-a3a4-13fd1ffe9aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebc4090-79dd-4158-a3a4-13fd1ffe9aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1678389665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71ff7c7-24ff-42a1-9eff-b1b89accfdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93e0717b0a54a83859c9d423b233869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:50Z,use_quota=True,user_id='97819a0c41af4f7397798cc9027a2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0296e0-2f0f-49ad-954f-ba7ec887ce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0296e0-2f0f-49ad-954f-ba7ec887ce5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631806bb-e13e-4d70-bb4f-91bec35ed6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631806bb-e13e-4d70-bb4f-91bec35ed6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71ff7c7-24ff-42a1-9eff-b1b89accfdeb', 'volume_name': 'volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9476cb1-b5c0-4fe1-9d4d-b0bd20683328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9476cb1-b5c0-4fe1-9d4d-b0bd20683328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a202e5-89e6-4f6d-9200-e0cd499090d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb', 'volume_size': 1} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1678389665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71ff7c7-24ff-42a1-9eff-b1b89accfdeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93e0717b0a54a83859c9d423b233869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:50Z,use_quota=True,user_id='97819a0c41af4f7397798cc9027a2e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Creating volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:50 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:50 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb 1073741824 Jul 06 15:32:50 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Flow 'volume_create_manager' (7ca33d3c-b7d7-4b72-8593-09f0403524fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5a438c-7c36-4ead-a632-f870c087e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5a438c-7c36-4ead-a632-f870c087e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1729221773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a7be3b-703e-4235-8da7-ae62e195f506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d1333f0d104cd19e3206a36bc2600c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:51Z,use_quota=True,user_id='afc345aa4abd464c839a12da95456fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac23b3a4-458a-4127-a2d3-b0985062207c),volume_type_id=ac23b3a4-458a-4127-a2d3-b0985062207c)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d89019f-5b84-4963-b5bf-b2170f333060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d89019f-5b84-4963-b5bf-b2170f333060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed576aef-f849-4140-9088-2f29ecf9626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed576aef-f849-4140-9088-2f29ecf9626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a7be3b-703e-4235-8da7-ae62e195f506', 'volume_name': 'volume-d4a7be3b-703e-4235-8da7-ae62e195f506', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1858bb3b-e40a-433f-9925-ac688b86ea8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1858bb3b-e40a-433f-9925-ac688b86ea8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a261568-3044-487e-a02a-03934fbfee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:50 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Volume d4a7be3b-703e-4235-8da7-ae62e195f506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a7be3b-703e-4235-8da7-ae62e195f506', 'volume_size': 1} Jul 06 15:32:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:32:51 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Flow 'volume_create_manager' (3dc65723-3f8d-4bc9-9186-a9eb7473c680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5a993-44dc-40f6-98a9-2691fb981955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb 1073741824" returned: 0 in 1.107s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5a993-44dc-40f6-98a9-2691fb981955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1927407454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee60738-f510-4af4-8006-e111858cdeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a9e0d7ed6846b8a32392f269952e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:51Z,use_quota=True,user_id='29a603f8b4fe40a48a16f3838677d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3b5edb-beac-45e1-ac37-18f7f443c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3b5edb-beac-45e1-ac37-18f7f443c29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f741b1a-38e1-407d-879b-f542be802a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f741b1a-38e1-407d-879b-f542be802a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee60738-f510-4af4-8006-e111858cdeb8', 'volume_name': 'volume-aee60738-f510-4af4-8006-e111858cdeb8', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b903be4b-a2b3-4a82-a950-f4d8587daf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b903be4b-a2b3-4a82-a950-f4d8587daf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cec0ff2-dea5-4a80-b050-5d1bf6f25c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Volume aee60738-f510-4af4-8006-e111858cdeb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee60738-f510-4af4-8006-e111858cdeb8', 'volume_size': 1} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:51 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb Jul 06 15:32:51 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:52 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" returned: 0 in 0.792s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1729221773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a7be3b-703e-4235-8da7-ae62e195f506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7d1333f0d104cd19e3206a36bc2600c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:51Z,use_quota=True,user_id='afc345aa4abd464c839a12da95456fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac23b3a4-458a-4127-a2d3-b0985062207c),volume_type_id=ac23b3a4-458a-4127-a2d3-b0985062207c)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Creating volume d4a7be3b-703e-4235-8da7-ae62e195f506 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:52 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a202e5-89e6-4f6d-9200-e0cd499090d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:52 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 1073741824 Jul 06 15:32:52 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176bbd3-78c6-480c-9585-3e7a31e7215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Volume volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb (e71ff7c7-24ff-42a1-9eff-b1b89accfdeb): created successfully Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f176bbd3-78c6-480c-9585-3e7a31e7215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Flow 'volume_create_manager' (a6864fa8-e727-4c92-b752-a3162155a39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c3786980-b92a-4246-8cca-f63e17973f1b tempest-SnapshotsActionsTest-657453801 None] Created volume successfully. Jul 06 15:32:53 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 1073741824" returned: 0 in 1.072s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:53 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 Jul 06 15:32:53 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:54 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506" returned: 0 in 0.857s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1927407454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee60738-f510-4af4-8006-e111858cdeb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a9e0d7ed6846b8a32392f269952e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:32:51Z,use_quota=True,user_id='29a603f8b4fe40a48a16f3838677d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Creating volume aee60738-f510-4af4-8006-e111858cdeb8 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:32:54 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:54 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 1073741824 Jul 06 15:32:54 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a261568-3044-487e-a02a-03934fbfee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a7be3b-703e-4235-8da7-ae62e195f506', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ca0621-22d6-4fb4-a5d8-7933f01ebe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:54 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Volume volume-d4a7be3b-703e-4235-8da7-ae62e195f506 (d4a7be3b-703e-4235-8da7-ae62e195f506): created successfully Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ca0621-22d6-4fb4-a5d8-7933f01ebe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Flow 'volume_create_manager' (7ca33d3c-b7d7-4b72-8593-09f0403524fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c0aa54e0-c7a2-447f-9088-e122a79aeb57 tempest-VolumeTypesAccessTest-1477553801 None] Created volume successfully. Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Acquiring lock "cinder-d4a7be3b-703e-4235-8da7-ae62e195f506-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Lock "cinder-d4a7be3b-703e-4235-8da7-ae62e195f506-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Acquiring lock "cinder-quobyte-d4a7be3b-703e-4235-8da7-ae62e195f506" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Lock "cinder-quobyte-d4a7be3b-703e-4235-8da7-ae62e195f506" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ba471-de26-49dc-bfa1-36c3eb100454]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:55 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 Jul 06 15:32:55 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:55 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 1073741824" returned: 0 in 1.003s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:55 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 Jul 06 15:32:55 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:56 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506" returned: 0 in 1.005s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:56 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506 Jul 06 15:32:56 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:56 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8" returned: 0 in 0.864s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.500s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Creating offline snapshot 70fad9bd-fa86-493b-b590-5cc64a7952d3 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cec0ff2-dea5-4a80-b050-5d1bf6f25c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee60738-f510-4af4-8006-e111858cdeb8', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d014246-5654-48b6-8a5c-d56e6b4d40eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6af5a50-2ddf-4e83-8264-50c23d5e259b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:56 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Volume volume-aee60738-f510-4af4-8006-e111858cdeb8 (aee60738-f510-4af4-8006-e111858cdeb8): created successfully Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d014246-5654-48b6-8a5c-d56e6b4d40eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Flow 'volume_create_manager' (3dc65723-3f8d-4bc9-9186-a9eb7473c680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:32:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3ed14b86-f0e8-4cca-b0ae-d5c193dfde0b tempest-AttachVolumeNegativeTest-2045782107 None] Created volume successfully. Jul 06 15:32:56 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb Jul 06 15:32:56 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:56 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d4a7be3b-703e-4235-8da7-ae62e195f506" returned: 0 in 0.760s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Lock "cinder-quobyte-d4a7be3b-703e-4235-8da7-ae62e195f506" released by "delete_volume" :: held 1.836s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:57 devstack cinder-volume[86191]: WARNING cinder.quota [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1999574215 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1999574215, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:57 devstack cinder-volume[86191]: WARNING cinder.quota [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1999574215 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1999574215, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Created reservations ['e37d6de9-1b5b-46e0-a947-bc64d1a7329c', '0a6cb447-e3a4-4e1c-8d40-4dde56908144', '6593f08e-8804-4da4-8df3-aa71e8652307', '7bd7a59a-985b-40a5-9c37-a046bc10dfa5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:57 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:32:57 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:57 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" returned: 0 in 0.876s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:57 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 1G Jul 06 15:32:57 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:57 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:32:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Deleted volume successfully. Jul 06 15:32:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9fce19b0-f2ac-4b28-be4e-77ce0342aaf7 tempest-VolumeTypesAccessTest-1477553801 None] Lock "cinder-d4a7be3b-703e-4235-8da7-ae62e195f506-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:32:58 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 1G" returned: 0 in 1.064s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:58 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:32:58 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:59 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 0.781s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:59 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 is being set with open permissions: ugo+rw Jul 06 15:32:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:59 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:32:59 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:32:59 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 06 15:32:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 0.769s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:32:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:32:59 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info Jul 06 15:32:59 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:00 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info" returned: 0 in 0.753s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:00 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info is being set with open permissions: ugo+rw Jul 06 15:33:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:00 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info Jul 06 15:33:00 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:01 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.info" returned: 0 in 0.709s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.077s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.056s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c79e126-6d0e-4eee-9775-b911871ff6b8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0a8e00ff-42ab-4ccb-83fa-5324888d5450 tempest-SnapshotsActionsTest-657453801 None] Create snapshot completed successfully Jul 06 15:33:01 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 Jul 06 15:33:01 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:02 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8" returned: 0 in 0.881s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-aee60738-f510-4af4-8006-e111858cdeb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48e71e7d-bdbc-4ae7-ad0f-883a8acafec0', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:33:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-d20e59f4-1227-4410-92c4-ff43d463412c req-f6086427-85a2-467e-8b77-37cb2d79a7be tempest-AttachVolumeNegativeTest-2045782107 None] attachment_update completed successfully. Jul 06 15:33:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Creating offline snapshot aa1e2583-ccf9-4b69-8496-25eed0093c78 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:33:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5d285-867f-4e9c-a611-5c2cfe761a51]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:03 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:03 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:04 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.113s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:04 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 1G Jul 06 15:33:04 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:05 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 1G" returned: 0 in 1.005s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:05 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 Jul 06 15:33:05 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:06 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78" returned: 0 in 0.733s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:06 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 is being set with open permissions: ugo+rw Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:06 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 Jul 06 15:33:06 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:06 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:06 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:07 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78" returned: 0 in 0.766s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.798s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9df8025a-8d0b-4b77-b52c-859df0b5761e tempest-SnapshotsActionsTest-657453801 None] Create snapshot completed successfully Jul 06 15:33:07 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.768s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 8 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-aa1e2583-ccf9-4b69-8496-25eed0093c78-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-aa1e2583-ccf9-4b69-8496-25eed0093c78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-aa1e2583-ccf9-4b69-8496-25eed0093c78" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-aa1e2583-ccf9-4b69-8496-25eed0093c78" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Deleting offline snapshot aa1e2583-ccf9-4b69-8496-25eed0093c78 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] snapshot_file for this snap is: volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[803b6987-189c-49f4-bee6-c3a682924b10]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:08 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 Jul 06 15:33:08 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:09 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78" returned: 0 in 1.028s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[992f85ad-66ce-45a9-b0d5-4927c8b98566]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:09 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:09 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-5c48be74-5f38-47d0-8364-f360f1c138b5 req-c5cda3c4-374c-4188-8a20-91eed2b1668c tempest-AttachVolumeNegativeTest-2045782107 None] Terminate volume connection completed successfully. Jul 06 15:33:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-5c48be74-5f38-47d0-8364-f360f1c138b5 req-c5cda3c4-374c-4188-8a20-91eed2b1668c tempest-AttachVolumeNegativeTest-2045782107 None] Deleting attachment 48e71e7d-bdbc-4ae7-ad0f-883a8acafec0. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:33:10 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.161s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:10 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 Jul 06 15:33:10 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:11 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78" returned: 0 in 1.010s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:11 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78 Jul 06 15:33:11 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:12 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.aa1e2583-ccf9-4b69-8496-25eed0093c78" returned: 0 in 0.942s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-aa1e2583-ccf9-4b69-8496-25eed0093c78" released by "_delete_snapshot" :: held 4.329s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" released by "delete_snapshot" :: held 4.383s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:12 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Created reservations ['8f2cc162-ae53-4fbc-9309-a34f16989d6c', '39ac51e4-1253-49b2-b2ea-0639c19e20c4', 'd06cc734-7937-47be-8bb7-6e79f313b56b', '3976ba0d-e19e-4bea-ba08-2df11d5b0165'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Delete snapshot completed successfully. Jul 06 15:33:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0b67da0d-bcb1-4150-97ae-3f82f471704e tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-aa1e2583-ccf9-4b69-8496-25eed0093c78-delete_snapshot" released by "delete_snapshot" :: held 4.621s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Creating offline snapshot 74832767-ebbc-48e1-995f-c48ee322a012 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:33:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5e5f0e-1ecd-40dd-9750-4cfdcc8628f6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:14 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:14 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:15 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (3cf873d3-a098-4549-83b9-ff7a5895b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15005ad-7819-4ebf-8e3c-3f55eaebcebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.528s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:15 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 1G Jul 06 15:33:15 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15005ad-7819-4ebf-8e3c-3f55eaebcebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157513863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0595029c-5c9d-45ce-a8ff-c49ca9efd3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:15Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d325ab9-c240-4de6-a587-1ca8454f7775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d325ab9-c240-4de6-a587-1ca8454f7775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889df746-576f-4ed0-a397-c233a8c6cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889df746-576f-4ed0-a397-c233a8c6cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0595029c-5c9d-45ce-a8ff-c49ca9efd3ad', 'volume_name': 'volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387b7ac-11b6-4fad-8480-79f638674974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387b7ac-11b6-4fad-8480-79f638674974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af11df6-8981-438f-b3d9-a17b1e9f86ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:15 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Volume 0595029c-5c9d-45ce-a8ff-c49ca9efd3ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad', 'volume_size': 1} Jul 06 15:33:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Flow 'volume_create_manager' (f9cae7f8-cab8-4555-8b56-bbd1c017a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4150a266-0fd8-4477-b8bd-4c434c2538e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4150a266-0fd8-4477-b8bd-4c434c2538e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-785628127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b781ff7f-7eda-448f-8cb3-7f7a849213b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e211dc582748fea28d3fb19f0c7982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:17Z,use_quota=True,user_id='6e9fef259fdc4ca9b2c3823cff5b3433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1d8573-7678-45b8-beb2-be4a9feeeac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1d8573-7678-45b8-beb2-be4a9feeeac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf02dfb-607f-4ca1-8b80-353071f74085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:33:16 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 1G" returned: 0 in 1.129s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:16 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 Jul 06 15:33:16 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf02dfb-607f-4ca1-8b80-353071f74085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b781ff7f-7eda-448f-8cb3-7f7a849213b1', 'volume_name': 'volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361d0ee9-a967-41fd-a893-5d2bc07947e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361d0ee9-a967-41fd-a893-5d2bc07947e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429fbdcc-9bb5-4e23-adc8-c18163c4ee28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:17 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Volume b781ff7f-7eda-448f-8cb3-7f7a849213b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Trying to clone b781ff7f-7eda-448f-8cb3-7f7a849213b1 from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:33:17 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012" returned: 0 in 0.799s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:17 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 is being set with open permissions: ugo+rw Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:33:17 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:33:17 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 Jul 06 15:33:17 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73b32bd-3035-48f8-9970-36a3accb7912]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:17 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD Jul 06 15:33:17 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:18 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012" returned: 0 in 0.786s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.555s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.646s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157513863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0595029c-5c9d-45ce-a8ff-c49ca9efd3ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:15Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Creating volume 0595029c-5c9d-45ce-a8ff-c49ca9efd3ad {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:18 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:18 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2d9bd433-fe48-493a-9f06-40f4c2ff76df tempest-SnapshotsActionsTest-657453801 None] Create snapshot completed successfully Jul 06 15:33:18 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad 1073741824 Jul 06 15:33:18 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:18 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD" returned: 0 in 0.825s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 is fetched for user 6e9fef259fdc4ca9b2c3823cff5b3433. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[876e92a4-23a5-4dd7-8fa1-908f1d6f6ce0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:18 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD Jul 06 15:33:18 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:19 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad 1073741824" returned: 0 in 0.936s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:19 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad Jul 06 15:33:19 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:19 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD" returned: 0 in 0.967s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-74832767-ebbc-48e1-995f-c48ee322a012-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-74832767-ebbc-48e1-995f-c48ee322a012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-74832767-ebbc-48e1-995f-c48ee322a012" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-74832767-ebbc-48e1-995f-c48ee322a012" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Deleting offline snapshot 74832767-ebbc-48e1-995f-c48ee322a012 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] snapshot_file for this snap is: volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a15e425-3ac4-4dfd-9a5d-022a9be0313d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:19 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 Jul 06 15:33:19 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:20 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" returned: 0 in 0.883s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-785628127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b781ff7f-7eda-448f-8cb3-7f7a849213b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7e211dc582748fea28d3fb19f0c7982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:17Z,use_quota=True,user_id='6e9fef259fdc4ca9b2c3823cff5b3433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Creating volume b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:20 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af11df6-8981-438f-b3d9-a17b1e9f86ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6a438e-9dd7-464f-b962-b4e3e7492a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:20 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 1073741824 Jul 06 15:33:20 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:20 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Volume volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad (0595029c-5c9d-45ce-a8ff-c49ca9efd3ad): created successfully Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6a438e-9dd7-464f-b962-b4e3e7492a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (3cf873d3-a098-4549-83b9-ff7a5895b59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f1ba2a55-f142-4883-bfc1-64586d772b76 tempest-VolumesActionsTest-2036630221 None] Created volume successfully. Jul 06 15:33:20 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012" returned: 0 in 0.832s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[914865b7-8890-4d83-baa5-1eb06205ae02]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:20 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:20 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a321d3df-e426-4a56-b45f-9e8f490e6aca tempest-VolumesActionsTest-2036630221 None] Acquiring lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" by "attach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a321d3df-e426-4a56-b45f-9e8f490e6aca tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" acquired by "attach_volume" :: waited 0.050s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:21 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a321d3df-e426-4a56-b45f-9e8f490e6aca tempest-VolumesActionsTest-2036630221 None] Attaching volume 0595029c-5c9d-45ce-a8ff-c49ca9efd3ad to instance 12dd3a5d-59ad-48d1-a0c7-ab30a3d548dd at mountpoint /dev/vdb on host None. Jul 06 15:33:21 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a321d3df-e426-4a56-b45f-9e8f490e6aca tempest-VolumesActionsTest-2036630221 None] Attach volume completed successfully. Jul 06 15:33:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a321d3df-e426-4a56-b45f-9e8f490e6aca tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" released by "attach_volume" :: held 0.270s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:21 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 1073741824" returned: 0 in 1.205s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:21 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:21 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:22 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.403s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:22 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 Jul 06 15:33:22 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f78d4b69-a26f-4cda-bb51-8b91e227d506 tempest-VolumesActionsTest-859440579 None] Terminate volume connection completed successfully. Jul 06 15:33:22 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 0 in 1.275s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] <== create_volume: return (2548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.553s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:22 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Attempting download of 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume b781ff7f-7eda-448f-8cb3-7f7a849213b1. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[023dea2d-d6bc-4726-9c3b-099002eca968]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f78d4b69-a26f-4cda-bb51-8b91e227d506 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-detach_volume" by "detach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f78d4b69-a26f-4cda-bb51-8b91e227d506 tempest-VolumesActionsTest-859440579 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f78d4b69-a26f-4cda-bb51-8b91e227d506 tempest-VolumesActionsTest-859440579 None] Detaching volume 0595029c-5c9d-45ce-a8ff-c49ca9efd3ad from instance 12dd3a5d-59ad-48d1-a0c7-ab30a3d548dd. Jul 06 15:33:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f78d4b69-a26f-4cda-bb51-8b91e227d506 tempest-VolumesActionsTest-859440579 None] Detach volume completed successfully. Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f78d4b69-a26f-4cda-bb51-8b91e227d506 tempest-VolumesActionsTest-859440579 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:23 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr Jul 06 15:33:23 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:23 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012" returned: 0 in 1.199s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:23 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012 Jul 06 15:33:23 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f292f426-3575-4aee-9d45-1ebae658217a tempest-VolumesActionsTest-2036630221 None] Acquiring lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-detach_volume" by "detach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f292f426-3575-4aee-9d45-1ebae658217a tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f292f426-3575-4aee-9d45-1ebae658217a tempest-VolumesActionsTest-2036630221 None] Volume detach called, but volume not attached. Jul 06 15:33:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f292f426-3575-4aee-9d45-1ebae658217a tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:24 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.74832767-ebbc-48e1-995f-c48ee322a012" returned: 0 in 0.859s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-74832767-ebbc-48e1-995f-c48ee322a012" released by "_delete_snapshot" :: held 4.442s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:24 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr" returned: 0 in 1.209s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" released by "delete_snapshot" :: held 4.495s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Created reservations ['469729b6-c7a2-4562-8879-a54a50186da2', 'd734c6cc-6d7e-40f8-9912-39ec7a2c8b2a', 'cfe1c08d-b2aa-4784-bbe1-5405ab5068cf', '4baa0a99-6ebd-415f-954b-cc96a1272129'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:24 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr Jul 06 15:33:24 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Delete snapshot completed successfully. Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8c1cb2df-2de9-4832-9b9f-3b528547f32a tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-74832767-ebbc-48e1-995f-c48ee322a012-delete_snapshot" released by "delete_snapshot" :: held 4.679s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "cinder-quobyte-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Lock "cinder-quobyte-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c91b5-9e12-4eb9-9989-e86143f08f26]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:24 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad Jul 06 15:33:24 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:25 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr" returned: 1 in 0.828s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_f9fsewvr' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[022834c0-9162-4e7d-a1ef-2acfe528f88d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:25 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD Jul 06 15:33:25 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Creating offline snapshot e901c02a-c4bb-432d-9653-27db8d8acf7a of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[460cd3b2-1a12-4175-bd75-0f00bfe6ed56]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:25 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:25 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:25 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" returned: 0 in 1.025s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:25 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad Jul 06 15:33:25 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:25 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD" returned: 0 in 0.896s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] 9a5687fe-7bc5-4daa-b5b4-270d79910583 was qcow2, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:33:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:26 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:26 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:26 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" returned: 0 in 0.711s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Lock "cinder-quobyte-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad" released by "delete_volume" :: held 1.801s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:26 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.008s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:26 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a 1G Jul 06 15:33:26 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Created reservations ['d438abf7-a941-4fd0-93f8-808cb0a0b486', '39ee38f0-8c82-4399-a934-656c6bd6bfa3', '61b39e81-276e-4b5c-8061-02f02d4d665f', '4c593666-80ce-4b1b-8f22-2f2080d88d0b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:26 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:26 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:27 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.812s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:27 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Deleted volume successfully. Jul 06 15:33:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7883061-8163-4374-9aa0-1ef48fc2de06 tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0595029c-5c9d-45ce-a8ff-c49ca9efd3ad-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:27 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a 1G" returned: 0 in 1.049s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:27 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a Jul 06 15:33:27 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:28 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 0 in 2.233s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:28 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oows7si3devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:33:28 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Converted 112.00 MB image at 50.12 MB/s Jul 06 15:33:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:28 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 1G Jul 06 15:33:28 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:28 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a" returned: 0 in 0.746s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:28 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a is being set with open permissions: ugo+rw Jul 06 15:33:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:28 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a Jul 06 15:33:28 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:29 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:29 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 1G" returned: 0 in 0.922s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.711s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffa64d6-3812-4404-9a13-cd97b8b18921]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9bf2544f-296c-4c2c-89ad-124a2bbbf6a5 tempest-SnapshotsActionsTest-657453801 None] Create snapshot completed successfully Jul 06 15:33:29 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:29 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-e901c02a-c4bb-432d-9653-27db8d8acf7a-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-e901c02a-c4bb-432d-9653-27db8d8acf7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-e901c02a-c4bb-432d-9653-27db8d8acf7a" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e901c02a-c4bb-432d-9653-27db8d8acf7a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Deleting offline snapshot e901c02a-c4bb-432d-9653-27db8d8acf7a of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] snapshot_file for this snap is: volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9f1db-4116-4f09-96e8-2e9a79d4e8b1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:30 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a Jul 06 15:33:30 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:30 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 0 in 1.002s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:30 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:30 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:30 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a" returned: 0 in 0.918s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[67891072-e84c-44ab-b14d-66da0f7ce849]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:31 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:31 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:31 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 1 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Downloaded image 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume b781ff7f-7eda-448f-8cb3-7f7a849213b1 successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 for user 6e9fef259fdc4ca9b2c3823cff5b3433 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Marking volume b781ff7f-7eda-448f-8cb3-7f7a849213b1 as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Copying metadata from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 to b781ff7f-7eda-448f-8cb3-7f7a849213b1. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Creating volume glance metadata for volume b781ff7f-7eda-448f-8cb3-7f7a849213b1 backed by image 9a5687fe-7bc5-4daa-b5b4-270d79910583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429fbdcc-9bb5-4e23-adc8-c18163c4ee28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6542d7be-1445-4ab1-aa97-c00729feccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Volume volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 (b781ff7f-7eda-448f-8cb3-7f7a849213b1): created successfully Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6542d7be-1445-4ab1-aa97-c00729feccb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Flow 'volume_create_manager' (f9cae7f8-cab8-4555-8b56-bbd1c017a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-58f7e79b-bb79-47c8-a3bd-6250da9a74dc tempest-VolumesImageMetadata-761379107 None] Created volume successfully. Jul 06 15:33:31 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.060s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:31 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a Jul 06 15:33:31 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Acquiring lock "cinder-b781ff7f-7eda-448f-8cb3-7f7a849213b1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Lock "cinder-b781ff7f-7eda-448f-8cb3-7f7a849213b1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Acquiring lock "cinder-quobyte-b781ff7f-7eda-448f-8cb3-7f7a849213b1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Lock "cinder-quobyte-b781ff7f-7eda-448f-8cb3-7f7a849213b1" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58cc5f7-17a3-4807-83b8-8867569be134]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:32 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:32 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:33 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a" returned: 0 in 1.065s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:33 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a Jul 06 15:33:33 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:33 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 0 in 0.868s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:33 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.e901c02a-c4bb-432d-9653-27db8d8acf7a" returned: 0 in 0.699s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e901c02a-c4bb-432d-9653-27db8d8acf7a" released by "_delete_snapshot" :: held 3.902s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" released by "delete_snapshot" :: held 3.943s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:33 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:33 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Created reservations ['6c8758f8-5b02-4677-91c0-efe59578510a', '313a53c9-bf36-432d-8ec4-3e9be2b2ed6a', '4384cbf7-3262-4523-a2a4-6a9d07d11acd', '3142eefd-0fcd-4151-b658-b8d0ca78cac2'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Delete snapshot completed successfully. Jul 06 15:33:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387a313d-ac2e-4126-8643-ecee592a9d9f tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-e901c02a-c4bb-432d-9653-27db8d8acf7a-delete_snapshot" released by "delete_snapshot" :: held 4.133s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (c177ee68-c21a-4202-be6c-dbaa0c40bb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b230eb1f-a764-4a36-80de-e50e513131e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b230eb1f-a764-4a36-80de-e50e513131e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698084138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7934cb80-15cd-459b-8193-d54be0d1b86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:34Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58da0aa9-8d04-450a-ab15-70fe1ae4b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58da0aa9-8d04-450a-ab15-70fe1ae4b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b342b84-fb70-44da-bb01-bfc5b8a78946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b342b84-fb70-44da-bb01-bfc5b8a78946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7934cb80-15cd-459b-8193-d54be0d1b86e', 'volume_name': 'volume-7934cb80-15cd-459b-8193-d54be0d1b86e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f06bd16-0192-42b0-b53f-232e185cde25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f06bd16-0192-42b0-b53f-232e185cde25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce243dce-490d-428f-b887-be454b0ac31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:34 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Volume 7934cb80-15cd-459b-8193-d54be0d1b86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7934cb80-15cd-459b-8193-d54be0d1b86e', 'volume_size': 1} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698084138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7934cb80-15cd-459b-8193-d54be0d1b86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:34Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Creating volume 7934cb80-15cd-459b-8193-d54be0d1b86e {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:34 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:34 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e 1073741824 Jul 06 15:33:34 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:34 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 1 in 0.905s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:33:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:34 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1 Jul 06 15:33:34 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:35 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b781ff7f-7eda-448f-8cb3-7f7a849213b1" returned: 0 in 0.640s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Lock "cinder-quobyte-b781ff7f-7eda-448f-8cb3-7f7a849213b1" released by "delete_volume" :: held 2.510s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:35 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e 1073741824" returned: 0 in 0.835s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Created reservations ['bab991ff-be42-4a44-9206-9d8037234f61', '87b745cf-5df7-4392-afc1-d759c42d3291', '9433a9ef-60cf-4de3-aa05-8c0d71ca44f4', 'f7c7365a-bad7-419e-b6af-5f9bccc6964e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:35 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e Jul 06 15:33:35 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:35 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:35 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:36 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e" returned: 0 in 0.739s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.583s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce243dce-490d-428f-b887-be454b0ac31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7934cb80-15cd-459b-8193-d54be0d1b86e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d587eab-03b0-4db7-9c97-e4d354194945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:36 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Creating offline snapshot 42753aa4-3791-45be-8446-f9250ea40739 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.765s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:36 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Deleted volume successfully. Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cc8730-6dbf-4a39-b87f-e2cf5a865c9c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:36 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Volume volume-7934cb80-15cd-459b-8193-d54be0d1b86e (7934cb80-15cd-459b-8193-d54be0d1b86e): created successfully Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d587eab-03b0-4db7-9c97-e4d354194945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (c177ee68-c21a-4202-be6c-dbaa0c40bb9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:36 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-03dd9436-53ab-4ca2-88b8-3daa259c548d tempest-VolumesActionsTest-2036630221 None] Created volume successfully. Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0518a58f-2650-481f-8284-81ca6897fcfe tempest-VolumesImageMetadata-761379107 None] Lock "cinder-b781ff7f-7eda-448f-8cb3-7f7a849213b1-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:36 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:36 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-7934cb80-15cd-459b-8193-d54be0d1b86e-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Lock "cinder-7934cb80-15cd-459b-8193-d54be0d1b86e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-quobyte-7934cb80-15cd-459b-8193-d54be0d1b86e" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-7934cb80-15cd-459b-8193-d54be0d1b86e" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[109af1c7-6aba-4840-8b32-bcc1648fa56b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:36 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e Jul 06 15:33:36 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:37 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.372s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:37 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 1G Jul 06 15:33:37 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:38 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e" returned: 0 in 1.493s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:38 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e Jul 06 15:33:38 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:38 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 1G" returned: 0 in 1.439s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:39 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 Jul 06 15:33:39 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:39 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7934cb80-15cd-459b-8193-d54be0d1b86e" returned: 0 in 0.958s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-7934cb80-15cd-459b-8193-d54be0d1b86e" released by "delete_volume" :: held 2.506s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Created reservations ['e2bf847a-f84f-4692-8070-1fc95b4db60a', '71f0c715-651d-4eff-8ea0-4d5c7e52622c', 'af48f088-3323-4801-8e2e-ecb667f20ba3', 'f7e9c794-6ed0-4c31-8db5-2d61aedcf01a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:39 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:39 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:39 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739" returned: 0 in 0.897s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:39 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 is being set with open permissions: ugo+rw Jul 06 15:33:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:39 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 Jul 06 15:33:39 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:40 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.999s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:40 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Deleted volume successfully. Jul 06 15:33:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6f292954-3a6b-40e3-905c-3fbb33a4e0a2 tempest-VolumesActionsTest-859440579 None] Lock "cinder-7934cb80-15cd-459b-8193-d54be0d1b86e-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:41 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739" returned: 0 in 1.182s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (3c0155d8-6917-49b7-ae3f-6c3428cd0434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce9a270-cbce-4548-8d15-33052f0c4d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.076s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce9a270-cbce-4548-8d15-33052f0c4d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-316959090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d81dd35-25b8-4fd7-8e55-9b215fe67042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:41Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf94937-42cb-46d7-b3e5-c21e7126f642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf94937-42cb-46d7-b3e5-c21e7126f642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0088f9fe-3313-426d-a14f-74ee0c2089e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0088f9fe-3313-426d-a14f-74ee0c2089e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d81dd35-25b8-4fd7-8e55-9b215fe67042', 'volume_name': 'volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fae9eb-13a1-47b5-9757-e2eb9d4e29f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42fae9eb-13a1-47b5-9757-e2eb9d4e29f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65db80b0-5eb6-4c5a-b293-a2bc47a7877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:41 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Volume 1d81dd35-25b8-4fd7-8e55-9b215fe67042: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042', 'volume_size': 1} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-316959090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d81dd35-25b8-4fd7-8e55-9b215fe67042,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:41Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Creating volume 1d81dd35-25b8-4fd7-8e55-9b215fe67042 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:41 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:41 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 1073741824 Jul 06 15:33:41 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:41 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9d29bd2d-afa2-4bde-84a8-e60c2734c49f tempest-SnapshotsActionsTest-657453801 None] Create snapshot completed successfully Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-42753aa4-3791-45be-8446-f9250ea40739-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-42753aa4-3791-45be-8446-f9250ea40739-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Acquiring lock "cinder-quobyte-42753aa4-3791-45be-8446-f9250ea40739" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-42753aa4-3791-45be-8446-f9250ea40739" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Deleting offline snapshot 42753aa4-3791-45be-8446-f9250ea40739 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] snapshot_file for this snap is: volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[72da7f7d-8b64-457b-b4ae-fd12ebc90e8a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:42 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 Jul 06 15:33:42 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:42 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 1073741824" returned: 0 in 1.359s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:42 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 Jul 06 15:33:42 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Flow 'volume_create_manager' (3b97c677-81b2-4d76-8e4b-a0577cdd0c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2daa1bd-7892-4e6b-880f-cb8fe2b440af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2daa1bd-7892-4e6b-880f-cb8fe2b440af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1194869065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06a355f-9698-4e70-adb3-da1b5ba231b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4388e2b64e794dacbb5bc30dcecab872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:43Z,use_quota=True,user_id='74e3130617c34a8f940d0771d1d7170c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee815eb-3310-4431-b234-68d30ab15cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee815eb-3310-4431-b234-68d30ab15cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92376dc5-be06-46e1-bb31-2cb5de099ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92376dc5-be06-46e1-bb31-2cb5de099ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06a355f-9698-4e70-adb3-da1b5ba231b2', 'volume_name': 'volume-f06a355f-9698-4e70-adb3-da1b5ba231b2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f222d52-f473-4a21-a70b-9b2cdec7c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f222d52-f473-4a21-a70b-9b2cdec7c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570c85eb-0c46-4975-aec2-e12afe061ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:43 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Volume f06a355f-9698-4e70-adb3-da1b5ba231b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06a355f-9698-4e70-adb3-da1b5ba231b2', 'volume_size': 1} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:43 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739" returned: 0 in 1.137s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde0dab0-3956-4e2b-ba93-8d5304e42faa]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:43 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:43 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:43 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042" returned: 0 in 1.114s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] <== create_volume: return (2559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1194869065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06a355f-9698-4e70-adb3-da1b5ba231b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4388e2b64e794dacbb5bc30dcecab872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:43Z,use_quota=True,user_id='74e3130617c34a8f940d0771d1d7170c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Creating volume f06a355f-9698-4e70-adb3-da1b5ba231b2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:43 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:43 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 1073741824 Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65db80b0-5eb6-4c5a-b293-a2bc47a7877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:43 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec18dc3-121d-41e7-805f-4321a699f4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:43 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Volume volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 (1d81dd35-25b8-4fd7-8e55-9b215fe67042): created successfully Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec18dc3-121d-41e7-805f-4321a699f4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (3c0155d8-6917-49b7-ae3f-6c3428cd0434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a92d9881-2ae3-473f-a844-733217db8cc5 tempest-VolumesActionsTest-2036630221 None] Created volume successfully. Jul 06 15:33:44 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 0.837s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:44 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 Jul 06 15:33:44 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-1d81dd35-25b8-4fd7-8e55-9b215fe67042-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Lock "cinder-1d81dd35-25b8-4fd7-8e55-9b215fe67042-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-quobyte-1d81dd35-25b8-4fd7-8e55-9b215fe67042" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-1d81dd35-25b8-4fd7-8e55-9b215fe67042" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef2496e-9e47-4fb4-9429-2c3c25cb4936]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:44 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 Jul 06 15:33:44 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:45 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 1073741824" returned: 0 in 1.266s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:45 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 Jul 06 15:33:45 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:45 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739" returned: 0 in 1.153s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:45 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739 Jul 06 15:33:45 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:45 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042" returned: 0 in 0.922s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:45 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042 Jul 06 15:33:45 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:45 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2" returned: 0 in 0.787s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570c85eb-0c46-4975-aec2-e12afe061ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06a355f-9698-4e70-adb3-da1b5ba231b2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee02090-fa16-43c2-b48a-3f3b745dbd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:45 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Volume volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 (f06a355f-9698-4e70-adb3-da1b5ba231b2): created successfully Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee02090-fa16-43c2-b48a-3f3b745dbd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Flow 'volume_create_manager' (3b97c677-81b2-4d76-8e4b-a0577cdd0c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-eb021d0d-a585-4c8a-8f97-87bb44892110 tempest-AbsoluteLimitsTests-1179665641 None] Created volume successfully. Jul 06 15:33:46 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.42753aa4-3791-45be-8446-f9250ea40739" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-42753aa4-3791-45be-8446-f9250ea40739" released by "_delete_snapshot" :: held 4.060s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" released by "delete_snapshot" :: held 4.092s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Created reservations ['da0cae1c-5852-4343-8dbb-7d538426ea9e', '386a1e3a-ad3e-4fa2-bdcd-e7d379bc490f', 'f72b3b88-722a-4869-a7f3-0cf2323c2a32', '32eca72e-1329-4479-a53c-f180b4fc2a4b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Delete snapshot completed successfully. Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5916d1d6-9c1d-4b42-9c33-a56453a34e5b tempest-SnapshotsActionsTest-1127423474 None] Lock "cinder-42753aa4-3791-45be-8446-f9250ea40739-delete_snapshot" released by "delete_snapshot" :: held 4.291s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:46 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d81dd35-25b8-4fd7-8e55-9b215fe67042" returned: 0 in 0.835s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-1d81dd35-25b8-4fd7-8e55-9b215fe67042" released by "delete_volume" :: held 1.833s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Created reservations ['8f4dee6f-4e55-46d2-9b01-f38a2cbe5310', 'a25080d0-040a-4302-83e8-f1f87d7911f7', 'f5046407-37e7-439b-bcf6-dd8318e296fa', '4b867f36-aa05-4038-b226-b4ecabb761de'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:46 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:46 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "cinder-70fad9bd-fa86-493b-b590-5cc64a7952d3-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-70fad9bd-fa86-493b-b590-5cc64a7952d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "cinder-quobyte-70fad9bd-fa86-493b-b590-5cc64a7952d3" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-quobyte-70fad9bd-fa86-493b-b590-5cc64a7952d3" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Deleting offline snapshot 70fad9bd-fa86-493b-b590-5cc64a7952d3 of volume e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] snapshot_file for this snap is: volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Acquiring lock "cinder-f06a355f-9698-4e70-adb3-da1b5ba231b2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2474a8df-de66-400a-87eb-cc69ba8e102a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Lock "cinder-f06a355f-9698-4e70-adb3-da1b5ba231b2-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Acquiring lock "cinder-quobyte-f06a355f-9698-4e70-adb3-da1b5ba231b2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Lock "cinder-quobyte-f06a355f-9698-4e70-adb3-da1b5ba231b2" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9cd37e-15db-4cea-9213-af4a8c86fa5c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:47 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:47 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:47 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:47 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 Jul 06 15:33:47 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.067s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (4ff70205-b11d-4066-a1a1-be3f10d0e41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dda6df-b1c3-4f3d-9c9b-d5021ddca533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Deleted volume successfully. Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dda6df-b1c3-4f3d-9c9b-d5021ddca533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-284120158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7f6d7-fc9e-4a62-9891-4027b441eb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:48Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c504a41-0226-4450-b5c0-245b848be3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c504a41-0226-4450-b5c0-245b848be3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559da6b4-4336-4b17-bb9e-a71ffca04a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559da6b4-4336-4b17-bb9e-a71ffca04a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a7f6d7-fc9e-4a62-9891-4027b441eb30', 'volume_name': 'volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7486ed-9751-464d-9a81-a3071e78d1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7486ed-9751-464d-9a81-a3071e78d1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d164c0-904c-4405-88db-8d0c518c261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Volume 89a7f6d7-fc9e-4a62-9891-4027b441eb30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30', 'volume_size': 1} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-284120158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7f6d7-fc9e-4a62-9891-4027b441eb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:48Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Creating volume 89a7f6d7-fc9e-4a62-9891-4027b441eb30 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:47 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7c53c9fe-0051-488d-94d5-1ef90c14ad4f tempest-VolumesActionsTest-859440579 None] Lock "cinder-1d81dd35-25b8-4fd7-8e55-9b215fe67042-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:47 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 1073741824 Jul 06 15:33:47 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:48 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 1.042s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a894dfbc-050c-4bc7-9163-9b031099007d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:48 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb Jul 06 15:33:48 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:48 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2" returned: 0 in 1.135s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:48 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2 Jul 06 15:33:48 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:48 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 1073741824" returned: 0 in 0.995s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=104,cinder:UPDATE=96,cinder:INSERT=30,cinder:DELETE=11 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:33:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:49 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 Jul 06 15:33:49 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:49 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" returned: 0 in 0.872s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:49 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:49 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:49 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f06a355f-9698-4e70-adb3-da1b5ba231b2" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Lock "cinder-quobyte-f06a355f-9698-4e70-adb3-da1b5ba231b2" released by "delete_volume" :: held 2.083s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=105,cinder:SELECT=94,cinder:INSERT=32,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Created reservations ['7fb9a040-078c-41f3-bae3-32ec5a4c6c99', 'fa0a1904-c44d-48b0-bfd8-bd3ce1eb761b', 'b17c49ab-c7f1-4637-a998-e61c22aa917f', 'd7bc8199-6da7-4e29-8371-f5a9fbfb4d00'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:49 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d164c0-904c-4405-88db-8d0c518c261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16489604-1ba2-4d36-a603-01d5c9e54cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Volume volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 (89a7f6d7-fc9e-4a62-9891-4027b441eb30): created successfully Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16489604-1ba2-4d36-a603-01d5c9e54cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (4ff70205-b11d-4066-a1a1-be3f10d0e41b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4915738d-e803-4eb0-bfd1-9f2fc7a75834 tempest-VolumesActionsTest-2036630221 None] Created volume successfully. Jul 06 15:33:49 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:49 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:50 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 0.898s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:50 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3 Jul 06 15:33:50 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:50 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.666s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:50 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Deleted volume successfully. Jul 06 15:33:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ac0349b-b773-4012-b581-65112ee39e10 tempest-AbsoluteLimitsTests-1179665641 None] Lock "cinder-f06a355f-9698-4e70-adb3-da1b5ba231b2-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:51 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb.70fad9bd-fa86-493b-b590-5cc64a7952d3" returned: 0 in 0.788s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-quobyte-70fad9bd-fa86-493b-b590-5cc64a7952d3" released by "_delete_snapshot" :: held 3.789s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" released by "delete_snapshot" :: held 3.837s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-89a7f6d7-fc9e-4a62-9891-4027b441eb30-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Lock "cinder-89a7f6d7-fc9e-4a62-9891-4027b441eb30-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-quobyte-89a7f6d7-fc9e-4a62-9891-4027b441eb30" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Created reservations ['2a30ccf4-f1f7-4ea8-9949-08dfad9608d4', '11565e3f-1db5-4c84-9584-23feabb1b4be', '9a60a327-cff2-4eb5-9999-2624071c75a5', '0e1a997b-cdc9-41f6-9bad-3409becf50e7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-89a7f6d7-fc9e-4a62-9891-4027b441eb30" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05faf8e-cb2e-4aff-a830-3fe0b4120069]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Delete snapshot completed successfully. Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7aa78180-37a2-49a2-98df-1a7f23e7a3d2 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-70fad9bd-fa86-493b-b590-5cc64a7952d3-delete_snapshot" released by "delete_snapshot" :: held 4.244s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:51 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 Jul 06 15:33:51 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "cinder-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d45154-8a90-40fa-b752-7d22d7a78078]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:52 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb Jul 06 15:33:52 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:52 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30" returned: 0 in 1.128s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:52 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30 Jul 06 15:33:52 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:52 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" returned: 0 in 0.976s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:52 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb Jul 06 15:33:52 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:53 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-89a7f6d7-fc9e-4a62-9891-4027b441eb30" returned: 0 in 0.808s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-89a7f6d7-fc9e-4a62-9891-4027b441eb30" released by "delete_volume" :: held 2.011s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Created reservations ['a9dcc460-d74e-40cd-b0a5-41b38af6adfa', 'e9bf4f91-19e7-400b-95b0-4a79f6d3b7c6', 'a0a19dee-b07f-42b2-a20b-002345da43d8', '6f239065-9c78-40d7-8a92-0fb6a23dd4f8'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:53 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:53 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:53 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-quobyte-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb" released by "delete_volume" :: held 1.894s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Created reservations ['0efee5da-3965-48f9-9f49-daaef0585585', '6a0bbe73-584b-4ed0-befb-c3e1193c1a22', 'b22d1640-4f37-4e98-b0e7-9a10d11db3cf', '9f708b2e-d85d-4fe6-8061-c37595441c6e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:53 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:33:53 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:54 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.806s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:54 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Deleted volume successfully. Jul 06 15:33:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a211cc8d-4af6-464b-9660-32efeb618dd5 tempest-VolumesActionsTest-859440579 None] Lock "cinder-89a7f6d7-fc9e-4a62-9891-4027b441eb30-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:54 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.744s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:54 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:33:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Deleted volume successfully. Jul 06 15:33:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c20417b-bf71-4120-972a-e95c0e5e2997 tempest-SnapshotsActionsTest-657453801 None] Lock "cinder-e71ff7c7-24ff-42a1-9eff-b1b89accfdeb-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (a5127b5e-459e-4f03-98e8-aaa6adebc670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb9810d-7fca-4a41-9a6c-e3d7eabde81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb9810d-7fca-4a41-9a6c-e3d7eabde81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2032926142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf364c8e-5790-469b-96dc-63cca9cacab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:55Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc283f10-ae02-40f6-aa2c-e4e14db8c4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc283f10-ae02-40f6-aa2c-e4e14db8c4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec96034d-9443-4068-8cdd-c4b2f86f49ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec96034d-9443-4068-8cdd-c4b2f86f49ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf364c8e-5790-469b-96dc-63cca9cacab7', 'volume_name': 'volume-bf364c8e-5790-469b-96dc-63cca9cacab7', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32eec415-f549-484d-8f06-3d4295e7e988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32eec415-f549-484d-8f06-3d4295e7e988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde1c671-4707-4571-861f-81db64df5eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:55 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Volume bf364c8e-5790-469b-96dc-63cca9cacab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf364c8e-5790-469b-96dc-63cca9cacab7', 'volume_size': 1} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2032926142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf364c8e-5790-469b-96dc-63cca9cacab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:55Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Creating volume bf364c8e-5790-469b-96dc-63cca9cacab7 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:55 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:55 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 1073741824 Jul 06 15:33:55 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:56 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 1073741824" returned: 0 in 1.019s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:56 devstack sudo[95650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 Jul 06 15:33:56 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:57 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7" returned: 0 in 0.762s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde1c671-4707-4571-861f-81db64df5eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf364c8e-5790-469b-96dc-63cca9cacab7', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eeedbed-7558-492b-8ad0-b8bfaf8158cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:57 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Volume volume-bf364c8e-5790-469b-96dc-63cca9cacab7 (bf364c8e-5790-469b-96dc-63cca9cacab7): created successfully Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eeedbed-7558-492b-8ad0-b8bfaf8158cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (a5127b5e-459e-4f03-98e8-aaa6adebc670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a9a8eef6-b666-4edc-bb00-4fd3af011dfb tempest-VolumesActionsTest-2036630221 None] Created volume successfully. Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Flow 'volume_create_manager' (c5064f11-5fc3-4b67-a769-86be49ad2223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f90722-eab8-43e6-bb64-041d95cdd347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f90722-eab8-43e6-bb64-041d95cdd347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-972140090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8cbf46-3951-4bb3-a37d-7cbcf0af4630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1f00d01429f98deeb2512c11016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:58Z,use_quota=True,user_id='542daa7eecf0442aa4462a93b2fc9c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175b91f8-e68a-4633-b68a-d549c4fd81ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175b91f8-e68a-4633-b68a-d549c4fd81ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538ed06f-0bfd-4f8d-a356-c0900357aba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538ed06f-0bfd-4f8d-a356-c0900357aba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8cbf46-3951-4bb3-a37d-7cbcf0af4630', 'volume_name': 'volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d3945d-56c4-474f-b937-2ed1a187fdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d3945d-56c4-474f-b937-2ed1a187fdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1420bec0-6a31-4041-8e8b-4dfda1f7ec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:33:58 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Volume 7f8cbf46-3951-4bb3-a37d-7cbcf0af4630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630', 'volume_size': 1} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-972140090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8cbf46-3951-4bb3-a37d-7cbcf0af4630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1f00d01429f98deeb2512c11016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:33:58Z,use_quota=True,user_id='542daa7eecf0442aa4462a93b2fc9c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Creating volume 7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:33:58 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:58 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 1073741824 Jul 06 15:33:58 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-bf364c8e-5790-469b-96dc-63cca9cacab7-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Lock "cinder-bf364c8e-5790-469b-96dc-63cca9cacab7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Acquiring lock "cinder-quobyte-bf364c8e-5790-469b-96dc-63cca9cacab7" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-bf364c8e-5790-469b-96dc-63cca9cacab7" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[879a71cf-96eb-447b-bb9e-fcabec17fdfb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:33:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:58 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 Jul 06 15:33:58 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:59 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 1073741824" returned: 0 in 1.039s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:59 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 Jul 06 15:33:59 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:33:59 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 06 15:33:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7" returned: 0 in 0.949s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:33:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:33:59 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7 Jul 06 15:33:59 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:00 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630" returned: 0 in 0.743s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1420bec0-6a31-4041-8e8b-4dfda1f7ec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9c3992-62ca-46f4-ae5f-063e09c848d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:00 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Volume volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 (7f8cbf46-3951-4bb3-a37d-7cbcf0af4630): created successfully Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea9c3992-62ca-46f4-ae5f-063e09c848d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Flow 'volume_create_manager' (c5064f11-5fc3-4b67-a769-86be49ad2223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-672b1604-e622-4fac-b1cd-a10c3fb46c5a tempest-VolumesTransfersTest-1455182805 None] Created volume successfully. Jul 06 15:34:00 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bf364c8e-5790-469b-96dc-63cca9cacab7" returned: 0 in 0.725s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Lock "cinder-quobyte-bf364c8e-5790-469b-96dc-63cca9cacab7" released by "delete_volume" :: held 1.738s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Created reservations ['1239cf5c-86ea-4e7c-9768-28c72dc45109', 'b870400e-f3d4-4af4-b23a-8784095495d8', '942026e4-27c5-49cb-9bd3-79787c9c4ae9', '2bc9b4be-a166-438a-81f7-ba0d3eac9ce8'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:00 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:00 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:01 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.689s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Deleted volume successfully. Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf8ab7c1-2c31-4f50-8537-2494e01ac5a9 tempest-VolumesActionsTest-859440579 None] Lock "cinder-bf364c8e-5790-469b-96dc-63cca9cacab7-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (c383f8c8-d6c0-48b8-a998-bb33dd054fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c43394-e1e5-4f74-9dab-5ab6dffff2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c43394-e1e5-4f74-9dab-5ab6dffff2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-307927949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bead1ce-424b-4797-b528-9e2c5295aade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:01Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c913fd62-c3f5-43d1-b744-5165d35351a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c913fd62-c3f5-43d1-b744-5165d35351a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7169f98a-2a50-4901-aeb2-fe44777ee66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7169f98a-2a50-4901-aeb2-fe44777ee66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bead1ce-424b-4797-b528-9e2c5295aade', 'volume_name': 'volume-0bead1ce-424b-4797-b528-9e2c5295aade', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e005bb0-9a79-496b-bb68-6a6e43f145f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e005bb0-9a79-496b-bb68-6a6e43f145f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d66f73-e845-4e47-a66e-a82b5a9b18c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Volume 0bead1ce-424b-4797-b528-9e2c5295aade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bead1ce-424b-4797-b528-9e2c5295aade', 'volume_size': 1} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-307927949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bead1ce-424b-4797-b528-9e2c5295aade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5322ed3972438b98ad747ead4a0634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:01Z,use_quota=True,user_id='cf91a67ffdbc4567aea29ca47a609ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Creating volume 0bead1ce-424b-4797-b528-9e2c5295aade {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:01 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:01 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade 1073741824 Jul 06 15:34:01 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-34d61f13-e70b-4547-812e-589a943ca68b tempest-VolumesTransfersTest-993046387 None] Transfer volume completed successfully. Jul 06 15:34:02 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade 1073741824" returned: 0 in 0.943s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:02 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade Jul 06 15:34:02 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:03 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade" returned: 0 in 0.746s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d66f73-e845-4e47-a66e-a82b5a9b18c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bead1ce-424b-4797-b528-9e2c5295aade', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a860b5-bbf9-4765-898b-2cc045b379d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Volume volume-0bead1ce-424b-4797-b528-9e2c5295aade (0bead1ce-424b-4797-b528-9e2c5295aade): created successfully Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a860b5-bbf9-4765-898b-2cc045b379d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Flow 'volume_create_manager' (c383f8c8-d6c0-48b8-a998-bb33dd054fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:03 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-56f1e057-7e4b-4788-9b00-563d4b7f10d6 tempest-VolumesActionsTest-2036630221 None] Created volume successfully. Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Acquiring lock "cinder-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Lock "cinder-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Acquiring lock "cinder-quobyte-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Lock "cinder-quobyte-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b482708-b330-4333-9c56-aeae7eae26e6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:03 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 Jul 06 15:34:03 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Flow 'volume_create_manager' (1d71eead-6c28-4fd3-8f99-50173fea4e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506a0f33-f1b6-40e2-bb49-1b9af2fc43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506a0f33-f1b6-40e2-bb49-1b9af2fc43e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-581421409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6faa49-737e-4eea-8cd4-244d4c936031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a9e0d7ed6846b8a32392f269952e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:04Z,use_quota=True,user_id='29a603f8b4fe40a48a16f3838677d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe624e0-9526-4237-988f-c1d2f2e132f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe624e0-9526-4237-988f-c1d2f2e132f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd410f80-4922-4fe6-b81e-c4cea89b2677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd410f80-4922-4fe6-b81e-c4cea89b2677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6faa49-737e-4eea-8cd4-244d4c936031', 'volume_name': 'volume-4d6faa49-737e-4eea-8cd4-244d4c936031', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715640ba-bf19-4be8-8610-896b361d6656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715640ba-bf19-4be8-8610-896b361d6656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d243a1-ae29-4103-8960-dc51e98c6aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Volume 4d6faa49-737e-4eea-8cd4-244d4c936031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6faa49-737e-4eea-8cd4-244d4c936031', 'volume_size': 1} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-581421409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6faa49-737e-4eea-8cd4-244d4c936031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a9e0d7ed6846b8a32392f269952e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:04Z,use_quota=True,user_id='29a603f8b4fe40a48a16f3838677d38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Creating volume 4d6faa49-737e-4eea-8cd4-244d4c936031 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:03 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 1073741824 Jul 06 15:34:03 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Acquiring lock "cinder-0bead1ce-424b-4797-b528-9e2c5295aade-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0bead1ce-424b-4797-b528-9e2c5295aade-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:04 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630" returned: 0 in 1.077s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:04 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630 Jul 06 15:34:04 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Acquiring lock "cinder-quobyte-0bead1ce-424b-4797-b528-9e2c5295aade" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Lock "cinder-quobyte-0bead1ce-424b-4797-b528-9e2c5295aade" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b936a815-7b39-4966-ac34-50bd439f7705]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:04 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade Jul 06 15:34:04 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:04 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 1073741824" returned: 0 in 1.098s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:04 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 Jul 06 15:34:05 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:05 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630" returned: 0 in 0.757s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Lock "cinder-quobyte-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630" released by "delete_volume" :: held 1.903s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Created reservations ['321386db-917f-483f-9375-77b51dc5ef74', '4177a0c9-af0d-48bd-aad5-9ace418d9623', '3a600ba0-e508-4537-ae96-df8c255a6e00', '79905f9a-465c-4d33-8d7e-3cbe0c3c7b87'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:05 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:05 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:05 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:05 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031" returned: 0 in 0.804s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade" returned: 0 in 1.130s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:05 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d243a1-ae29-4103-8960-dc51e98c6aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6faa49-737e-4eea-8cd4-244d4c936031', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:05 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bff1c4f-76bd-43b3-856e-a92f57aaadb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:05 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Volume volume-4d6faa49-737e-4eea-8cd4-244d4c936031 (4d6faa49-737e-4eea-8cd4-244d4c936031): created successfully Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bff1c4f-76bd-43b3-856e-a92f57aaadb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Flow 'volume_create_manager' (1d71eead-6c28-4fd3-8f99-50173fea4e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2f35b1a1-e01e-4818-b428-6e2c1b4dd3e3 tempest-AttachVolumeNegativeTest-2045782107 None] Created volume successfully. Jul 06 15:34:06 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Flow 'volume_create_manager' (18804c51-6f76-4f78-92d0-c8d28c63ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324f2bf-4a67-4c48-999c-c7a78bcb85f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.943s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324f2bf-4a67-4c48-999c-c7a78bcb85f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1876223261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88a7ced-0143-4ffa-b6c7-9f749ce90a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1f00d01429f98deeb2512c11016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:06Z,use_quota=True,user_id='542daa7eecf0442aa4462a93b2fc9c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2a3138-725f-4d60-9a91-3fa255df950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e2a3138-725f-4d60-9a91-3fa255df950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c23f0c-dbd1-4096-8825-408b51ba78b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c23f0c-dbd1-4096-8825-408b51ba78b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88a7ced-0143-4ffa-b6c7-9f749ce90a7b', 'volume_name': 'volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a7ec1-a928-44f0-b57e-6a454016ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a7ec1-a928-44f0-b57e-6a454016ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4556e1cf-aaed-4506-8271-0140eb1e770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Volume a88a7ced-0143-4ffa-b6c7-9f749ce90a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b', 'volume_size': 1} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1876223261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88a7ced-0143-4ffa-b6c7-9f749ce90a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df13d1f00d01429f98deeb2512c11016',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:06Z,use_quota=True,user_id='542daa7eecf0442aa4462a93b2fc9c48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Creating volume a88a7ced-0143-4ffa-b6c7-9f749ce90a7b {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:06 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Deleted volume successfully. Jul 06 15:34:06 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b 1073741824 Jul 06 15:34:06 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-704c5232-8391-494d-8e04-4ddc1ae1e7ae tempest-VolumesTransfersTest-121076756 None] Lock "cinder-7f8cbf46-3951-4bb3-a37d-7cbcf0af4630-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:06 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0bead1ce-424b-4797-b528-9e2c5295aade" returned: 0 in 0.853s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Lock "cinder-quobyte-0bead1ce-424b-4797-b528-9e2c5295aade" released by "delete_volume" :: held 2.050s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Created reservations ['feb9bb63-09b0-4419-8bb2-e33a86b7104c', 'cae7c383-39b9-470f-929e-b25c179ac9ff', '68fe14da-b527-4a0e-a4c9-3a9e5593d2fd', '294ba533-2c64-411a-b977-aa8f81bdba76'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:06 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:06 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:06 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:06 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:07 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b 1073741824" returned: 0 in 1.057s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:07 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b Jul 06 15:34:07 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:07 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.907s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:07 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.881s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Deleted volume successfully. Jul 06 15:34:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a7e4b35e-1b50-4e53-93e3-8b39a328e35f tempest-VolumesActionsTest-2036630221 None] Lock "cinder-0bead1ce-424b-4797-b528-9e2c5295aade-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:08 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4556e1cf-aaed-4506-8271-0140eb1e770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26260b6c-c2ef-4a18-a18d-94d19e6408d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Volume volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b (a88a7ced-0143-4ffa-b6c7-9f749ce90a7b): created successfully Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26260b6c-c2ef-4a18-a18d-94d19e6408d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Flow 'volume_create_manager' (18804c51-6f76-4f78-92d0-c8d28c63ae36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2a27f6ac-522c-48ec-b1a3-40a1c438604b tempest-VolumesTransfersTest-1455182805 None] Created volume successfully. Jul 06 15:34:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Acquiring lock "cinder-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Lock "cinder-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Acquiring lock "cinder-quobyte-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Lock "cinder-quobyte-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f4ba1e-44f3-49fb-b4ac-049476fd1f17]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:10 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b Jul 06 15:34:10 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:10 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0918f9b-98a3-48d8-97dc-1d4565cc2935]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:10 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 Jul 06 15:34:10 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:11 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b" returned: 0 in 1.052s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:11 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b Jul 06 15:34:11 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:11 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031" returned: 0 in 1.071s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.093s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-4d6faa49-737e-4eea-8cd4-244d4c936031', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69751c6c-5f2c-40b1-bc7b-d7c464a3eb01', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:34:11 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-be9da8ac-8086-4827-9589-bc8bf781697f req-62ea05a3-bc17-4446-9b89-782e3811c5e1 tempest-AttachVolumeNegativeTest-2045782107 None] attachment_update completed successfully. Jul 06 15:34:11 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b" returned: 0 in 0.852s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Lock "cinder-quobyte-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b" released by "delete_volume" :: held 1.955s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:11 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Created reservations ['ca408cac-4b13-4b0d-a0ed-cdd59130768d', 'f32294db-b7cf-4e1f-9c22-146862e86c81', '132279a3-3d8d-496b-8bc0-5873a3fa0dd9', '5af7df9b-870e-4471-8c8b-82e14eafd372'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:12 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:12 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.823s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:12 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:12 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Deleted volume successfully. Jul 06 15:34:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d463da00-3f21-491d-a362-30b8ecea18e0 tempest-VolumesTransfersTest-121076756 None] Lock "cinder-a88a7ced-0143-4ffa-b6c7-9f749ce90a7b-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:18 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-ec454bf7-7e24-4584-b688-53c5fdc1ec92 req-abbe6778-8072-4417-8c58-d3153f77257b tempest-AttachVolumeNegativeTest-2045782107 None] Terminate volume connection completed successfully. Jul 06 15:34:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-ec454bf7-7e24-4584-b688-53c5fdc1ec92 req-abbe6778-8072-4417-8c58-d3153f77257b tempest-AttachVolumeNegativeTest-2045782107 None] Deleting attachment 69751c6c-5f2c-40b1-bc7b-d7c464a3eb01. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Flow 'volume_create_manager' (f480ae3d-a39f-4736-af4e-e9581f288110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b5f0f0-a3fe-4476-b939-2544a2193505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b5f0f0-a3fe-4476-b939-2544a2193505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-228448208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa0b88f-c735-400b-9bc6-d973aad61490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb93e4e7f05d4c65aa054210dd6bd3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:24Z,use_quota=True,user_id='39a4f9733a2e4acc87507d6525a585c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bf29d6-46cd-4965-9554-8c987e2a29b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54bf29d6-46cd-4965-9554-8c987e2a29b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f823776-4bd3-4776-9449-d94d505d7cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f823776-4bd3-4776-9449-d94d505d7cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa0b88f-c735-400b-9bc6-d973aad61490', 'volume_name': 'volume-aaa0b88f-c735-400b-9bc6-d973aad61490', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2cda32-7299-433a-88c1-84d577d412c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea2cda32-7299-433a-88c1-84d577d412c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729f44b3-b203-4581-a962-f4caea054a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Volume aaa0b88f-c735-400b-9bc6-d973aad61490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa0b88f-c735-400b-9bc6-d973aad61490', 'volume_size': 1} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-228448208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa0b88f-c735-400b-9bc6-d973aad61490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb93e4e7f05d4c65aa054210dd6bd3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:24Z,use_quota=True,user_id='39a4f9733a2e4acc87507d6525a585c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Creating volume aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:24 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:24 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 1073741824 Jul 06 15:34:24 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Flow 'volume_create_manager' (a18706c0-cab5-4c7c-a83a-b75961942d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaa7ab8-7edb-48f8-b786-81df9adcc930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaa7ab8-7edb-48f8-b786-81df9adcc930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1403882276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755f3fd1-5fe4-4a28-b088-c4a51d4f5734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278a1fbfca4b72a1ba93dc0f7efab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:25Z,use_quota=True,user_id='368802b0b47047c38a2fa88ce9a67fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d252a49-ecdb-4ce1-8eab-6c8aaab47b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d252a49-ecdb-4ce1-8eab-6c8aaab47b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de64517-e6b7-4c70-a0db-76a56a74d9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de64517-e6b7-4c70-a0db-76a56a74d9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755f3fd1-5fe4-4a28-b088-c4a51d4f5734', 'volume_name': 'volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1da1cc-ab92-4b54-a17a-99d499f7510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1da1cc-ab92-4b54-a17a-99d499f7510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8ae273-c7ff-4fa5-89e9-3bf58c061061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Volume 755f3fd1-5fe4-4a28-b088-c4a51d4f5734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734', 'volume_size': 1} Jul 06 15:34:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:25 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 1073741824" returned: 0 in 1.087s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:25 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:25 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:26 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.759s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1403882276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755f3fd1-5fe4-4a28-b088-c4a51d4f5734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278a1fbfca4b72a1ba93dc0f7efab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:25Z,use_quota=True,user_id='368802b0b47047c38a2fa88ce9a67fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Creating volume 755f3fd1-5fe4-4a28-b088-c4a51d4f5734 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:26 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:26 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 1073741824 Jul 06 15:34:26 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729f44b3-b203-4581-a962-f4caea054a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa0b88f-c735-400b-9bc6-d973aad61490', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29adadec-4838-463c-a940-a995ece41792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:26 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Volume volume-aaa0b88f-c735-400b-9bc6-d973aad61490 (aaa0b88f-c735-400b-9bc6-d973aad61490): created successfully Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29adadec-4838-463c-a940-a995ece41792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Flow 'volume_create_manager' (f480ae3d-a39f-4736-af4e-e9581f288110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:26 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e454cafe-6fa0-4125-bdc1-2d3c476b4376 tempest-VolumesCloneTest-374220170 None] Created volume successfully. Jul 06 15:34:27 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 1073741824" returned: 0 in 1.110s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:27 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 Jul 06 15:34:27 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Flow 'volume_create_manager' (bf4c1080-bad4-4f18-accb-3a9163e4edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0349f6b3-db4d-4c8d-99be-ced0f09e1fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0349f6b3-db4d-4c8d-99be-ced0f09e1fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1888121007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1435690f-d2ac-4525-bb51-c1ae96fc149c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb93e4e7f05d4c65aa054210dd6bd3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=aaa0b88f-c735-400b-9bc6-d973aad61490,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:28Z,use_quota=True,user_id='39a4f9733a2e4acc87507d6525a585c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c311285-3078-4a97-b35c-e8b2952b698a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c311285-3078-4a97-b35c-e8b2952b698a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a20fad-5a66-40ce-adeb-6a49f8a729b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a20fad-5a66-40ce-adeb-6a49f8a729b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1435690f-d2ac-4525-bb51-c1ae96fc149c', 'volume_name': 'volume-1435690f-d2ac-4525-bb51-c1ae96fc149c', 'volume_size': 2, 'source_volid': 'aaa0b88f-c735-400b-9bc6-d973aad61490', 'source_volstatus': 'available'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8b432b-ab3d-4b12-962c-7e522306b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b8b432b-ab3d-4b12-962c-7e522306b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c257a7-2809-44b6-9e0f-ee99b72b27cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Volume 1435690f-d2ac-4525-bb51-c1ae96fc149c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1435690f-d2ac-4525-bb51-c1ae96fc149c', 'volume_size': 2, 'source_volid': 'aaa0b88f-c735-400b-9bc6-d973aad61490', 'source_volstatus': 'available'} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:28 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734" returned: 0 in 0.836s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.217s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:28 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Cloning volume aaa0b88f-c735-400b-9bc6-d973aad61490 to volume 1435690f-d2ac-4525-bb51-c1ae96fc149c Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8ae273-c7ff-4fa5-89e9-3bf58c061061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab15959-1c24-4ea5-8b05-3690881c7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Volume volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 (755f3fd1-5fe4-4a28-b088-c4a51d4f5734): created successfully Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab15959-1c24-4ea5-8b05-3690881c7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Flow 'volume_create_manager' (a18706c0-cab5-4c7c-a83a-b75961942d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Creating offline snapshot 01eb9213-2641-44fe-9852-03140d572a83 of volume aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3888c1f0-1278-417e-b1e9-755a890fbaab]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-23ed4285-4443-464d-8c34-6198ea331430 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Created volume successfully. Jul 06 15:34:28 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:28 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:29 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.907s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:29 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 1G Jul 06 15:34:29 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Flow 'volume_create_manager' (bdbe21cf-08f0-4681-a5a4-59c177b5cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab199fb1-67c6-4a30-b7b0-608e31859aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab199fb1-67c6-4a30-b7b0-608e31859aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1657032877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd10617-28c1-40e8-a9e4-306655537b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30db262f327342bd9e2e12cfa57f577a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:31Z,use_quota=True,user_id='3d95812360e4403ca1502418a279d836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eafb76-4db3-45fd-a176-a215f5b8c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68eafb76-4db3-45fd-a176-a215f5b8c70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7082de28-77fd-4835-b61b-27214eba070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7082de28-77fd-4835-b61b-27214eba070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd10617-28c1-40e8-a9e4-306655537b20', 'volume_name': 'volume-7cd10617-28c1-40e8-a9e4-306655537b20', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b94b75b-ed6b-4d06-b965-52f322a6d667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b94b75b-ed6b-4d06-b965-52f322a6d667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7a25fc-2ca8-4559-954c-1c1b1bfc1909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Volume 7cd10617-28c1-40e8-a9e4-306655537b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd10617-28c1-40e8-a9e4-306655537b20', 'volume_size': 1} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:30 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 1G" returned: 0 in 1.058s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa0b88f-c735-400b-9bc6-d973aad61490 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:30 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa0b88f-c735-400b-9bc6-d973aad61490 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 Jul 06 15:34:30 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Acquiring lock "cinder-755f3fd1-5fe4-4a28-b088-c4a51d4f5734-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "cinder-755f3fd1-5fe4-4a28-b088-c4a51d4f5734-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Acquiring lock "cinder-quobyte-755f3fd1-5fe4-4a28-b088-c4a51d4f5734" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "cinder-quobyte-755f3fd1-5fe4-4a28-b088-c4a51d4f5734" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff6967-4882-43fb-904c-b070a7095834]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "cinder-4d6faa49-737e-4eea-8cd4-244d4c936031-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-4d6faa49-737e-4eea-8cd4-244d4c936031-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "cinder-quobyte-4d6faa49-737e-4eea-8cd4-244d4c936031" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-quobyte-4d6faa49-737e-4eea-8cd4-244d4c936031" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41985e0-531b-49b6-aa8f-d51fb9286f07]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:31 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 Jul 06 15:34:31 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:31 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaa0b88f-c735-400b-9bc6-d973aad61490 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83" returned: 0 in 0.880s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:31 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 is being set with open permissions: ugo+rw Jul 06 15:34:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:31 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 Jul 06 15:34:31 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:31 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 Jul 06 15:34:31 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:32 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734" returned: 0 in 0.849s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:32 devstack sudo[96253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734 Jul 06 15:34:32 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:32 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:32 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031" returned: 0 in 0.804s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83" returned: 0 in 0.666s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:32 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031 Jul 06 15:34:32 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:32 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info Jul 06 15:34:32 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:32 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-755f3fd1-5fe4-4a28-b088-c4a51d4f5734" returned: 0 in 0.702s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "cinder-quobyte-755f3fd1-5fe4-4a28-b088-c4a51d4f5734" released by "delete_volume" :: held 1.627s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Created reservations ['f24a309d-83c0-488f-8afe-7e0dabfac77a', 'f235e7db-2b4e-450b-9180-25b81e56d87c', '0131360c-8c69-48b1-9a7b-dab1a55e74bd', 'd050a70d-c507-4162-8396-4352fc52d440'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:32 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4d6faa49-737e-4eea-8cd4-244d4c936031" returned: 0 in 0.685s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-quobyte-4d6faa49-737e-4eea-8cd4-244d4c936031" released by "delete_volume" :: held 1.540s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:33 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info" returned: 0 in 0.711s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:33 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info is being set with open permissions: ugo+rw Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:33 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:33 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:33 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info Jul 06 15:34:33 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Created reservations ['51c73081-b6d2-46e2-8965-19cba0819d0d', '0103305f-db6a-4cf0-952c-8f09e2a5ff9d', '7ba3bfbd-5eea-4a09-ac2f-a8d2f1b88197', 'db5253cf-0697-4dc6-ad9b-f3e5f2fcfb8d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:33 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:33 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:33 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.700s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Deleted volume successfully. Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ff9e1b33-eae9-465f-b1b0-3c3754ca88a0 tempest-VolumeQuotasNegativeTestJSON-1531361257 None] Lock "cinder-755f3fd1-5fe4-4a28-b088-c4a51d4f5734-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "cinder-aee60738-f510-4af4-8006-e111858cdeb8-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:33 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.info" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Acquiring lock "cinder-quobyte-1435690f-d2ac-4525-bb51-c1ae96fc149c" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-aee60738-f510-4af4-8006-e111858cdeb8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-1435690f-d2ac-4525-bb51-c1ae96fc149c" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] snapshot: 01eb9213-2641-44fe-9852-03140d572a83, volume: 1435690f-d2ac-4525-bb51-c1ae96fc149c, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e18ab5f-f7fc-4833-95ff-6017064c1622]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "cinder-quobyte-aee60738-f510-4af4-8006-e111858cdeb8" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:33 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.844s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:33 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Deleted volume successfully. Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-quobyte-aee60738-f510-4af4-8006-e111858cdeb8" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bf4ee0f5-f1a8-4136-ae91-eef0712246e2 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-4d6faa49-737e-4eea-8cd4-244d4c936031-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d089a42c-0acd-4ce6-8d95-ee4dab057f92]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:34 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 Jul 06 15:34:34 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:34 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 Jul 06 15:34:34 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:34 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83" returned: 0 in 0.833s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaa0b88f-c735-400b-9bc6-d973aad61490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d32af0-e3a2-4896-a1c3-c6b78eb716c0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:34 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8" returned: 0 in 0.917s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:34 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:34 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:34 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8 Jul 06 15:34:34 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:35 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aee60738-f510-4af4-8006-e111858cdeb8" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-quobyte-aee60738-f510-4af4-8006-e111858cdeb8" released by "delete_volume" :: held 1.693s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:35 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.898s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:35 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c Jul 06 15:34:35 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Created reservations ['61ff36b5-fb5d-41a1-a46a-e5ce25113cde', '38566812-28aa-467c-b338-6605cdee64de', 'cf101457-c172-4705-bb89-ce0a1eba7caf', '4a4bb0eb-a06f-476e-9bb8-d635b4816b97'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:35 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:35 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "cinder-8e8ed6d9-162f-40da-8a55-db91c301a747-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-8e8ed6d9-162f-40da-8a55-db91c301a747-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "cinder-quobyte-8e8ed6d9-162f-40da-8a55-db91c301a747" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-quobyte-8e8ed6d9-162f-40da-8a55-db91c301a747" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[64973418-fe46-4cf0-8328-cb840a029f67]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:36 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.804s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:36 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Deleted volume successfully. Jul 06 15:34:36 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 Jul 06 15:34:36 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-872c6aff-d77f-4037-9ab2-27223c4852cc tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-aee60738-f510-4af4-8006-e111858cdeb8-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:38 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747" returned: 0 in 1.501s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:38 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747 Jul 06 15:34:38 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:40 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e8ed6d9-162f-40da-8a55-db91c301a747" returned: 0 in 2.118s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-quobyte-8e8ed6d9-162f-40da-8a55-db91c301a747" released by "delete_volume" :: held 3.684s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Created reservations ['bd448f0a-5f6f-4670-aaec-7705f79fb0d9', 'f01267ff-208f-4f06-bf90-af9aeac32727', 'cf395afd-ad5e-497a-8540-b7d140726c21', 'd84cbe69-a5c7-408b-954b-f6ba2aa80003'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:40 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:40 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:41 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:41 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.469s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:41 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:41 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Deleted volume successfully. Jul 06 15:34:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c" returned: 0 in 6.205s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:41 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc05b5-79e1-4dda-b123-204fa8f99a82]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-51c2f622-070d-4d29-9fa1-c44193d07eb3 tempest-AttachVolumeNegativeTest-2045782107 None] Lock "cinder-8e8ed6d9-162f-40da-8a55-db91c301a747-delete_volume" released by "delete_volume" :: held 5.554s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:42 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:42 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Flow 'volume_create_manager' (31af03cb-6500-45b0-98a2-70a114c8357d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a44849-8ada-4221-9fdf-55da78f573f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a44849-8ada-4221-9fdf-55da78f573f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1812193854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24ef93d-9495-4f52-8eea-925774ae37c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebd6b453f6459785fe73d3b06ebce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:43Z,use_quota=True,user_id='e7602d34c40041d7b3c099d705e4e0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d33105e-b5bd-4d01-b416-902105180c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d33105e-b5bd-4d01-b416-902105180c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fd9c04-18f3-48e2-8b2c-754c9c531b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69fd9c04-18f3-48e2-8b2c-754c9c531b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24ef93d-9495-4f52-8eea-925774ae37c1', 'volume_name': 'volume-f24ef93d-9495-4f52-8eea-925774ae37c1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc3bcdd-f702-46d1-b24b-84c5dffb9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc3bcdd-f702-46d1-b24b-84c5dffb9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae37698f-c476-479b-a973-f7f18440763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Volume f24ef93d-9495-4f52-8eea-925774ae37c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24ef93d-9495-4f52-8eea-925774ae37c1', 'volume_size': 1} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:42 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.962s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:34:42 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Converted 1024.00 MB image at 164.98 MB/s Jul 06 15:34:42 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c is being set with open permissions: ugo+rw Jul 06 15:34:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:42 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c Jul 06 15:34:42 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:43 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c" returned: 0 in 0.671s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-1435690f-d2ac-4525-bb51-c1ae96fc149c" released by "_copy_volume_from_snapshot" :: held 9.701s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Acquiring lock "cinder-quobyte-01eb9213-2641-44fe-9852-03140d572a83" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-01eb9213-2641-44fe-9852-03140d572a83" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Deleting offline snapshot 01eb9213-2641-44fe-9852-03140d572a83 of volume aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] snapshot_file for this snap is: volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a91a0a4-3fd8-423e-ac5e-8978f464e110]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:43 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 Jul 06 15:34:43 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:44 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83" returned: 0 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaa0b88f-c735-400b-9bc6-d973aad61490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:34:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[09712c12-9462-4614-8ee4-cbd8a03e1705]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:44 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:44 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:45 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.887s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:45 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 Jul 06 15:34:45 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:46 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83" returned: 0 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:46 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83 Jul 06 15:34:46 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:46 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490.01eb9213-2641-44fe-9852-03140d572a83" returned: 0 in 0.671s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-01eb9213-2641-44fe-9852-03140d572a83" released by "_delete_snapshot" :: held 3.258s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.280s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.218s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1657032877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd10617-28c1-40e8-a9e4-306655537b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30db262f327342bd9e2e12cfa57f577a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:31Z,use_quota=True,user_id='3d95812360e4403ca1502418a279d836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Creating volume 7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:46 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c257a7-2809-44b6-9e0f-ee99b72b27cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1435690f-d2ac-4525-bb51-c1ae96fc149c', 'volume_size': 2, 'source_volid': 'aaa0b88f-c735-400b-9bc6-d973aad61490', 'source_volstatus': 'available'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:46 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 1073741824 Jul 06 15:34:46 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3430119-a443-4886-96a1-b4480bcc743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Volume volume-1435690f-d2ac-4525-bb51-c1ae96fc149c (1435690f-d2ac-4525-bb51-c1ae96fc149c): created successfully Jul 06 15:34:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3430119-a443-4886-96a1-b4480bcc743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Flow 'volume_create_manager' (bf4c1080-bad4-4f18-accb-3a9163e4edef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ee581a2c-af7d-4076-8de9-542f710e4708 tempest-VolumesCloneTest-374220170 None] Created volume successfully. Jul 06 15:34:47 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 1073741824" returned: 0 in 0.857s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:47 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:34:47 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Acquiring lock "cinder-1435690f-d2ac-4525-bb51-c1ae96fc149c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Lock "cinder-1435690f-d2ac-4525-bb51-c1ae96fc149c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Acquiring lock "cinder-quobyte-1435690f-d2ac-4525-bb51-c1ae96fc149c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-1435690f-d2ac-4525-bb51-c1ae96fc149c" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f6bf7e-26de-4a4e-9ae0-bfee574d04bf]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:48 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c Jul 06 15:34:48 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:48 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.737s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.906s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1812193854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24ef93d-9495-4f52-8eea-925774ae37c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebd6b453f6459785fe73d3b06ebce2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:43Z,use_quota=True,user_id='e7602d34c40041d7b3c099d705e4e0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Creating volume f24ef93d-9495-4f52-8eea-925774ae37c1 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:48 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:48 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 1073741824 Jul 06 15:34:48 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7a25fc-2ca8-4559-954c-1c1b1bfc1909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd10617-28c1-40e8-a9e4-306655537b20', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaa64cf-b596-4856-80fa-089e84cb8ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:48 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Volume volume-7cd10617-28c1-40e8-a9e4-306655537b20 (7cd10617-28c1-40e8-a9e4-306655537b20): created successfully Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaa64cf-b596-4856-80fa-089e84cb8ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Flow 'volume_create_manager' (bdbe21cf-08f0-4681-a5a4-59c177b5cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ab3d0c44-4261-401d-9f17-7c17b7be203d tempest-VolumesActionsTest-412347381 None] Created volume successfully. Jul 06 15:34:49 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c" returned: 0 in 0.836s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:49 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c Jul 06 15:34:49 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=82,cinder:INSERT=30,cinder:UPDATE=132,cinder:DELETE=9 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:34:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a3d919fc-c08c-4a61-9f1a-9d5fe30c3d8c tempest-GroupSnapshotsTest-1944361660 None] Group tempest-GroupSnapshotsTest-Group-205703167: creating Jul 06 15:34:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a3d919fc-c08c-4a61-9f1a-9d5fe30c3d8c tempest-GroupSnapshotsTest-1944361660 None] Group tempest-GroupSnapshotsTest-Group-205703167: created successfully Jul 06 15:34:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a3d919fc-c08c-4a61-9f1a-9d5fe30c3d8c tempest-GroupSnapshotsTest-1944361660 None] Create group completed successfully. Jul 06 15:34:49 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 1073741824" returned: 0 in 0.926s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:49 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 Jul 06 15:34:49 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:49 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1435690f-d2ac-4525-bb51-c1ae96fc149c" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-1435690f-d2ac-4525-bb51-c1ae96fc149c" released by "delete_volume" :: held 1.616s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=97,cinder:UPDATE=123,cinder:DELETE=12,cinder:INSERT=28 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Created reservations ['61140738-aacf-4f81-b422-a2b85c6fef0d', 'e3c568a6-4a8a-4289-acfa-07c3581b406b', 'b133930f-8cce-4389-9998-e41170950ce0', '7738c98c-a451-40f9-a2d7-9e5f42fa6155'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:49 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:49 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:50 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1" returned: 0 in 0.737s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae37698f-c476-479b-a973-f7f18440763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24ef93d-9495-4f52-8eea-925774ae37c1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14943298-fdf1-4e13-8ebf-50c31c20133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:50 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Volume volume-f24ef93d-9495-4f52-8eea-925774ae37c1 (f24ef93d-9495-4f52-8eea-925774ae37c1): created successfully Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14943298-fdf1-4e13-8ebf-50c31c20133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Flow 'volume_create_manager' (31af03cb-6500-45b0-98a2-70a114c8357d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cf245e46-2db4-4966-ac1b-bcebeab2356f tempest-VolumesServicesTestJSON-109732225 None] Created volume successfully. Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Acquiring lock "cinder-aaa0b88f-c735-400b-9bc6-d973aad61490-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Lock "cinder-aaa0b88f-c735-400b-9bc6-d973aad61490-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Acquiring lock "cinder-quobyte-aaa0b88f-c735-400b-9bc6-d973aad61490" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-aaa0b88f-c735-400b-9bc6-d973aad61490" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec84fd9-072a-48d0-b964-3866051c2c15]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:50 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.736s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Deleted volume successfully. Jul 06 15:34:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2785aa33-5689-4375-8078-9b1eff3bd867 tempest-VolumesCloneTest-374220170 None] Lock "cinder-1435690f-d2ac-4525-bb51-c1ae96fc149c-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:50 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:50 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (2328509a-2a9b-4bcc-8df9-7f4b2ed0db02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bc570b-2bd4-4dd9-95ce-e0fa731691ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1bc570b-2bd4-4dd9-95ce-e0fa731691ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-902478414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a834147c-5717-424e-9e35-ab9a8315e623,host='devstack@QuobyteHD#QuobyteHD',id=8b301508-6a60-46fb-90e4-57c557099bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:51Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbdf5341-e75b-433b-9bc4-3e8a848aa49b),volume_type_id=cbdf5341-e75b-433b-9bc4-3e8a848aa49b)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5016c3f-1517-417a-a1a0-483c3eb845d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5016c3f-1517-417a-a1a0-483c3eb845d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28676bc5-897b-4778-956d-19ba0a3a94cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28676bc5-897b-4778-956d-19ba0a3a94cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b301508-6a60-46fb-90e4-57c557099bf6', 'volume_name': 'volume-8b301508-6a60-46fb-90e4-57c557099bf6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdd017a-7310-4371-964b-6acdfb8eb5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdd017a-7310-4371-964b-6acdfb8eb5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f284aab-a726-411f-b9f7-114204394fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Volume 8b301508-6a60-46fb-90e4-57c557099bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b301508-6a60-46fb-90e4-57c557099bf6', 'volume_size': 1} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a834147c-5717-424e-9e35-ab9a8315e623,created_at=2026-07-06T13:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-902478414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a834147c-5717-424e-9e35-ab9a8315e623,host='devstack@QuobyteHD#QuobyteHD',id=8b301508-6a60-46fb-90e4-57c557099bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:51Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbdf5341-e75b-433b-9bc4-3e8a848aa49b),volume_type_id=cbdf5341-e75b-433b-9bc4-3e8a848aa49b)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Creating volume 8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:34:51 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:51 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 1073741824 Jul 06 15:34:51 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Acquiring lock "cinder-f24ef93d-9495-4f52-8eea-925774ae37c1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Lock "cinder-f24ef93d-9495-4f52-8eea-925774ae37c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Acquiring lock "cinder-quobyte-f24ef93d-9495-4f52-8eea-925774ae37c1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Lock "cinder-quobyte-f24ef93d-9495-4f52-8eea-925774ae37c1" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf405855-2fc6-4074-b00c-e718b9e89ff5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:51 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.974s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:51 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490 Jul 06 15:34:51 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:51 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 Jul 06 15:34:51 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:52 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 1073741824" returned: 0 in 0.972s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:52 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-aaa0b88f-c735-400b-9bc6-d973aad61490" returned: 0 in 0.713s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Lock "cinder-quobyte-aaa0b88f-c735-400b-9bc6-d973aad61490" released by "delete_volume" :: held 1.760s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:52 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:52 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:34:52 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1" returned: 0 in 0.914s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:52 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1 Jul 06 15:34:52 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Created reservations ['24b4ca13-6014-4408-bb53-48925fb51e19', 'b1eee5cb-bf7a-449e-8206-4a22462d6797', '2e86f39c-447f-42f4-9b1e-eff737a0ca12', '25731daf-3bba-4b4d-9e47-dfab57ba35c3'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:52 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:52 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:53 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 0.869s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:53 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f284aab-a726-411f-b9f7-114204394fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b301508-6a60-46fb-90e4-57c557099bf6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5867dc16-f124-4951-9c98-02efddb4933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Deleted volume successfully. Jul 06 15:34:53 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Volume volume-8b301508-6a60-46fb-90e4-57c557099bf6 (8b301508-6a60-46fb-90e4-57c557099bf6): created successfully Jul 06 15:34:53 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5867dc16-f124-4951-9c98-02efddb4933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (2328509a-2a9b-4bcc-8df9-7f4b2ed0db02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f24ef93d-9495-4f52-8eea-925774ae37c1" returned: 0 in 0.904s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5cf28d27-56b1-40a0-90f4-9c19b9e2787d tempest-GroupSnapshotsTest-1944361660 None] Created volume successfully. Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b278d76-fa7d-4580-a60f-359dcfa01eb6 tempest-VolumesCloneTest-374220170 None] Lock "cinder-aaa0b88f-c735-400b-9bc6-d973aad61490-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Lock "cinder-quobyte-f24ef93d-9495-4f52-8eea-925774ae37c1" released by "delete_volume" :: held 1.870s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Created reservations ['7c4c4dfd-8079-48c4-882d-58ca56d0664b', '22871854-92cc-48cc-aad4-b124d23f2ba2', '21b56782-74d2-46a8-91b0-63fdbabc292c', 'bba33f56-5065-4f3c-9f1e-b58080cd0a54'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:34:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:53 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:34:53 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] GroupSnapshot ce8695ba-33b1-4d36-8eec-d63c84e21335: creating. Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Group snapshot ce8695ba-33b1-4d36-8eec-d63c84e21335: creating. {{(pid=86191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Creating offline snapshot b187d36d-df31-4f20-ab74-d8271087f093 of volume 8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d43843-82a3-4384-a18f-e22c5398d57b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:54 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:34:54 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:54 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.043s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:34:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Deleted volume successfully. Jul 06 15:34:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ec647424-a448-4c92-be64-4a1704cb3e35 tempest-VolumesServicesTestJSON-109732225 None] Lock "cinder-f24ef93d-9495-4f52-8eea-925774ae37c1-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:34:55 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 1.038s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:55 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 1G Jul 06 15:34:55 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:56 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 1G" returned: 0 in 1.114s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b301508-6a60-46fb-90e4-57c557099bf6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:56 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b301508-6a60-46fb-90e4-57c557099bf6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 Jul 06 15:34:56 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:57 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b301508-6a60-46fb-90e4-57c557099bf6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093" returned: 0 in 1.143s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:57 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:34:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:57 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 Jul 06 15:34:57 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Flow 'volume_create_manager' (63b5e41e-5b1b-4fbe-992b-d897a6534349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e51ab0-a0fb-4f8c-8531-4a1dbc617252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e51ab0-a0fb-4f8c-8531-4a1dbc617252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-465024149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560eb440-b3df-4e49-a523-ac882a2c9aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d4be3257754e2a92e2a420c43eb555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:58Z,use_quota=True,user_id='239f129a1bae4d55bcb68bf98552f4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347d02e5-623b-4a75-b688-ec1b743749bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347d02e5-623b-4a75-b688-ec1b743749bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89298f8-89c4-4a90-aa01-cb3de936dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:34:58 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093" returned: 0 in 0.965s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:58 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info Jul 06 15:34:58 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89298f8-89c4-4a90-aa01-cb3de936dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '560eb440-b3df-4e49-a523-ac882a2c9aac', 'volume_name': 'volume-560eb440-b3df-4e49-a523-ac882a2c9aac', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ff3365-6109-40ff-8120-6c4c02bba8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ff3365-6109-40ff-8120-6c4c02bba8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9602b0-03a8-4ed8-9d2f-e759157b771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:34:58 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Volume 560eb440-b3df-4e49-a523-ac882a2c9aac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-560eb440-b3df-4e49-a523-ac882a2c9aac', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:34:58 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Trying to clone 560eb440-b3df-4e49-a523-ac882a2c9aac from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:34:59 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:34:59 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:59 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d8f2b5-6fc5-4d2f-9d04-fc1f1b2cfaf0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:34:59 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info Jul 06 15:34:59 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:59 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD Jul 06 15:34:59 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:34:59 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.info" returned: 0 in 0.664s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:34:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.895s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:00 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 is fetched for user 239f129a1bae4d55bcb68bf98552f4c3. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:35:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7651a243-497a-4178-a43a-b694de64170f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot ce8695ba-33b1-4d36-8eec-d63c84e21335: created successfully Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280de3a-dded-47fd-b076-48d63d8c8a07]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:00 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD Jul 06 15:35:00 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:00 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-465024149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560eb440-b3df-4e49-a523-ac882a2c9aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d4be3257754e2a92e2a420c43eb555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:34:58Z,use_quota=True,user_id='239f129a1bae4d55bcb68bf98552f4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Creating volume 560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:00 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:35:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:01 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 1073741824 Jul 06 15:35:01 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Flow 'volume_create_manager' (994b18d5-cf76-49b9-9f5c-ed2e555fd2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea494659-265a-4fbb-a65c-c013fa584a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea494659-265a-4fbb-a65c-c013fa584a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-512824777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2711500a-c6fd-4afc-8bfd-9c75ff05490d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f13e9c38144ec9cbf4cec63b4627f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:01Z,use_quota=True,user_id='b575bc6a911f4e92b76fcfb83efab887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf9ec5a-9a84-46fd-ad3a-89127600cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf9ec5a-9a84-46fd-ad3a-89127600cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c58ca7f-e49b-442b-bc08-a9dce6586910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c58ca7f-e49b-442b-bc08-a9dce6586910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2711500a-c6fd-4afc-8bfd-9c75ff05490d', 'volume_name': 'volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a93c6c-a54d-435c-89e8-a8b32457d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a93c6c-a54d-435c-89e8-a8b32457d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db6b3c2-eed9-4fdd-b2be-6a273d4bb99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Volume 2711500a-c6fd-4afc-8bfd-9c75ff05490d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d', 'volume_size': 1} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:02 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 1073741824" returned: 0 in 1.183s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:02 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:02 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:03 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 0 in 0.875s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-512824777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2711500a-c6fd-4afc-8bfd-9c75ff05490d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f13e9c38144ec9cbf4cec63b4627f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:01Z,use_quota=True,user_id='b575bc6a911f4e92b76fcfb83efab887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Creating volume 2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:03 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d 1073741824 Jul 06 15:35:03 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Attempting download of 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume 560eb440-b3df-4e49-a523-ac882a2c9aac. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd65fcc-9c9d-47ed-a69b-dd78cf669935]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:03 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts Jul 06 15:35:03 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:04 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d 1073741824" returned: 0 in 0.969s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:04 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts" returned: 0 in 0.942s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:04 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d Jul 06 15:35:04 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:04 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts Jul 06 15:35:04 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:04 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d" returned: 0 in 0.842s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.302s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-b187d36d-df31-4f20-ab74-d8271087f093-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db6b3c2-eed9-4fdd-b2be-6a273d4bb99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41690856-d917-4c79-9ed2-498336f9ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-b187d36d-df31-4f20-ab74-d8271087f093-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Creating volume 342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 from snapshot b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:04 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts" returned: 1 in 0.877s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_t1xwhxts' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23f17f3-0bcb-426e-8bf5-fd55e272872a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:05 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Volume volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d (2711500a-c6fd-4afc-8bfd-9c75ff05490d): created successfully Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41690856-d917-4c79-9ed2-498336f9ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Flow 'volume_create_manager' (994b18d5-cf76-49b9-9f5c-ed2e555fd2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] snapshot: b187d36d-df31-4f20-ab74-d8271087f093, volume: 342c79c6-8bc6-401a-b532-4b0fc5d4a6c0, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:35:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-72e1ab09-d834-485b-a763-6f0fb9873503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Created volume successfully. Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[19880927-d6f0-432c-9310-f371cf84b812]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:05 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD Jul 06 15:35:05 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:05 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 Jul 06 15:35:05 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:05 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] 9a5687fe-7bc5-4daa-b5b4-270d79910583 was qcow2, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:35:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:05 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:05 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:06 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093" returned: 0 in 1.043s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b301508-6a60-46fb-90e4-57c557099bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c2286-f605-4a77-b998-5d93f01950ee]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:06 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:35:06 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8a1e19c-a8f3-43bf-8f9c-9e7f56c2ab27 tempest-VolumesActionsTest-412347381 None] Acquiring lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20" by "attach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8a1e19c-a8f3-43bf-8f9c-9e7f56c2ab27 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20" acquired by "attach_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b8a1e19c-a8f3-43bf-8f9c-9e7f56c2ab27 tempest-VolumesActionsTest-412347381 None] Attaching volume 7cd10617-28c1-40e8-a9e4-306655537b20 to instance fff9890f-28e0-4619-924c-54b1d0d4a81e at mountpoint /dev/vdb on host None. Jul 06 15:35:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b8a1e19c-a8f3-43bf-8f9c-9e7f56c2ab27 tempest-VolumesActionsTest-412347381 None] Attach volume completed successfully. Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8a1e19c-a8f3-43bf-8f9c-9e7f56c2ab27 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20" released by "attach_volume" :: held 0.111s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:06 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:06 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d56e1726-bea8-4e7c-84d7-cb95368db1e1 tempest-VolumesActionsTest-412347381 None] Acquiring lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-detach_volume" by "detach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d56e1726-bea8-4e7c-84d7-cb95368db1e1 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d56e1726-bea8-4e7c-84d7-cb95368db1e1 tempest-VolumesActionsTest-412347381 None] Detaching volume 7cd10617-28c1-40e8-a9e4-306655537b20 from instance fff9890f-28e0-4619-924c-54b1d0d4a81e. Jul 06 15:35:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d56e1726-bea8-4e7c-84d7-cb95368db1e1 tempest-VolumesActionsTest-412347381 None] Detach volume completed successfully. Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d56e1726-bea8-4e7c-84d7-cb95368db1e1 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:07 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 1.263s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:07 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 Jul 06 15:35:07 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:07 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.867s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:35:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:35:09 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 0 in 3.112s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:09 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_78261zfrdevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:35:09 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Converted 112.00 MB image at 35.96 MB/s Jul 06 15:35:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:09 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 1G Jul 06 15:35:09 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:10 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 1G" returned: 0 in 1.297s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:10 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[08168e21-b18e-4757-8e7a-54c23a968ed7]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:10 devstack sudo[96681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:10 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:12 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 0 in 1.678s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:12 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:12 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:13 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 1 in 1.781s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:35:13 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Downloaded image 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume 560eb440-b3df-4e49-a523-ac882a2c9aac successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 for user 239f129a1bae4d55bcb68bf98552f4c3 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Marking volume 560eb440-b3df-4e49-a523-ac882a2c9aac as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" returned: 0 in 6.442s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Copying metadata from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 to 560eb440-b3df-4e49-a523-ac882a2c9aac. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Creating volume glance metadata for volume 560eb440-b3df-4e49-a523-ac882a2c9aac backed by image 9a5687fe-7bc5-4daa-b5b4-270d79910583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f75926b-36c4-4855-8fd4-7aa06d0e2f92]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9602b0-03a8-4ed8-9d2f-e759157b771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560eb440-b3df-4e49-a523-ac882a2c9aac', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c2d98-0a30-4703-b90a-6bd313b488d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:14 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:35:14 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:14 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Volume volume-560eb440-b3df-4e49-a523-ac882a2c9aac (560eb440-b3df-4e49-a523-ac882a2c9aac): created successfully Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006c2d98-0a30-4703-b90a-6bd313b488d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Flow 'volume_create_manager' (63b5e41e-5b1b-4fbe-992b-d897a6534349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:14 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cf720319-27c4-44ec-ac4d-8d8e1a729598 tempest-VolumesExtendTest-385084564 None] Created volume successfully. Jul 06 15:35:14 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 0.974s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:35:14 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Converted 1024.00 MB image at 158.94 MB/s Jul 06 15:35:14 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:35:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:14 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 Jul 06 15:35:14 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:15 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" returned: 0 in 0.632s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" released by "_copy_volume_from_snapshot" :: held 10.496s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-b187d36d-df31-4f20-ab74-d8271087f093-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" released by "_create_volume_from_snapshot" :: held 10.566s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.604s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.172s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Creating offline snapshot 6aa127e5-74dc-45c3-9534-6be3830a4636 of volume 2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fef5d5-63d6-4c2d-8637-87d2ecdb402e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8f414484-1cde-4582-b0b8-407e55bca5c0 tempest-GroupSnapshotsTest-1944361660 None] Create group from source-snapshot-ce8695ba-33b1-4d36-8eec-d63c84e21335 completed successfully. Jul 06 15:35:15 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d Jul 06 15:35:15 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:16 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d" returned: 0 in 0.783s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:16 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 1G Jul 06 15:35:16 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:17 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[77025f37-6b16-4abf-90eb-e7c53de447ab]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:17 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 Jul 06 15:35:17 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:17 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 1G" returned: 0 in 0.919s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:17 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 Jul 06 15:35:17 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:17 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" returned: 0 in 0.842s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:17 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0 Jul 06 15:35:17 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:18 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636" returned: 0 in 0.822s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:18 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 is being set with open permissions: ugo+rw Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:18 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 Jul 06 15:35:18 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:18 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" returned: 0 in 0.732s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-342c79c6-8bc6-401a-b532-4b0fc5d4a6c0" released by "delete_volume" :: held 1.620s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['cf47a24a-65e7-43af-8965-6e3ba4777c77'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:18 devstack cinder-volume[86191]: WARNING cinder.quota [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-931748430 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-931748430, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:35:18 devstack cinder-volume[86191]: WARNING cinder.quota [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-931748430 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-931748430, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['5355047d-33e4-4595-ad33-10096f44effa', '494af698-99ca-499b-a915-b4bce8147e9a', 'b550b64e-3266-4251-a563-02ae185f3424', '30cca515-1f2e-414b-b204-6e14b17ea63c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:18 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636" returned: 0 in 0.673s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:18 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:18 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:18 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info Jul 06 15:35:18 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] group_snapshot ce8695ba-33b1-4d36-8eec-d63c84e21335: deleting Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] group_snapshot ce8695ba-33b1-4d36-8eec-d63c84e21335: deleting {{(pid=86191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:35:19 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:19 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-8b301508-6a60-46fb-90e4-57c557099bf6" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info" returned: 0 in 0.666s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:19 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info is being set with open permissions: ugo+rw Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e31b4d30-950f-4178-90f4-3a1c9c6af0b7 tempest-GroupSnapshotsTest-1944361660 None] Delete group completed successfully. Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-8b301508-6a60-46fb-90e4-57c557099bf6" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-b187d36d-df31-4f20-ab74-d8271087f093" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:19 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info Jul 06 15:35:19 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-b187d36d-df31-4f20-ab74-d8271087f093" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Deleting offline snapshot b187d36d-df31-4f20-ab74-d8271087f093 of volume 8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] snapshot_file for this snap is: volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[09515425-6a2a-4d62-b890-20b424175981]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:19 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 Jul 06 15:35:19 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:20 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.info" returned: 0 in 0.753s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.129s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-266df298-c771-44cb-8db6-a7e7a9c39c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Create snapshot completed successfully Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf5024-188d-4363-b03c-47fd69e74e7b]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:20 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:20 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:20 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093" returned: 0 in 0.839s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b301508-6a60-46fb-90e4-57c557099bf6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9508419-27c3-4af5-9b88-f6f6387366cb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:20 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:35:20 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:21 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 0 in 0.742s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:21 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:21 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:21 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 0.799s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:21 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 Jul 06 15:35:21 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "cinder-6aa127e5-74dc-45c3-9534-6be3830a4636-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-6aa127e5-74dc-45c3-9534-6be3830a4636-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "cinder-quobyte-2711500a-c6fd-4afc-8bfd-9c75ff05490d" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-quobyte-2711500a-c6fd-4afc-8bfd-9c75ff05490d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "cinder-quobyte-6aa127e5-74dc-45c3-9534-6be3830a4636" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-quobyte-6aa127e5-74dc-45c3-9534-6be3830a4636" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Deleting offline snapshot 6aa127e5-74dc-45c3-9534-6be3830a4636 of volume 2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] snapshot_file for this snap is: volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f3e99-245c-4efc-a61d-3fc266660f9f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:21 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 1 in 0.902s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:35:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 2G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac 2G" returned: 0 in 0.070s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.759s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:22 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 Jul 06 15:35:22 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-66f4b177-11aa-4910-8e2b-cb97c11a8665 tempest-VolumesExtendTest-385084564 None] Extend volume completed successfully. Jul 06 15:35:22 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093" returned: 0 in 0.845s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:22 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093 Jul 06 15:35:22 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:22 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636" returned: 0 in 0.803s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0b80b1-55aa-4b6f-8842-20c33a8425ae]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:22 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6.b187d36d-df31-4f20-ab74-d8271087f093" returned: 0 in 0.747s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:22 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d Jul 06 15:35:22 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-b187d36d-df31-4f20-ab74-d8271087f093" released by "_delete_snapshot" :: held 3.370s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-8b301508-6a60-46fb-90e4-57c557099bf6" released by "delete_snapshot" :: held 3.402s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:23 devstack cinder-volume[86191]: WARNING cinder.quota [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-931748430 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-931748430, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-560eb440-b3df-4e49-a523-ac882a2c9aac-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['7a98af51-0124-4ff1-b255-820c3e1b721e', '74623e93-72c9-4bb5-962e-a08840af79c4', '3398d3c0-1f8d-43fd-a3d0-dd6d73ed11b5', '903e9866-0474-49f6-83dd-0484e99d42aa'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Lock "cinder-560eb440-b3df-4e49-a523-ac882a2c9aac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-quobyte-560eb440-b3df-4e49-a523-ac882a2c9aac" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-560eb440-b3df-4e49-a523-ac882a2c9aac" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-942b3321-e1f4-48c0-b5b4-5f17a1b55819 tempest-GroupSnapshotsTest-1944361660 None] group_snapshot ce8695ba-33b1-4d36-8eec-d63c84e21335: deleted successfully Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812e14b-ad97-40f9-b5e3-5f35dd5f2a95]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:23 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:23 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:23 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d" returned: 0 in 1.093s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:23 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 Jul 06 15:35:23 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-8b301508-6a60-46fb-90e4-57c557099bf6" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-8b301508-6a60-46fb-90e4-57c557099bf6" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:24 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 0 in 1.088s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:24 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb98ef-1ca6-4f1c-a8ec-84b1fd98788c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:24 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:35:24 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:24 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:24 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:25 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636" returned: 0 in 1.130s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:25 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636 Jul 06 15:35:25 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:25 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 1 in 0.989s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:25 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac Jul 06 15:35:25 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:25 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 1.119s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:25 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6 Jul 06 15:35:25 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:25 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d.6aa127e5-74dc-45c3-9534-6be3830a4636" returned: 0 in 0.737s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-quobyte-6aa127e5-74dc-45c3-9534-6be3830a4636" released by "_delete_snapshot" :: held 3.902s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-quobyte-2711500a-c6fd-4afc-8bfd-9c75ff05490d" released by "delete_snapshot" :: held 3.929s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Created reservations ['35f7d41e-1458-47b5-9552-523ee56975ed', '3a37179f-e0f0-49a7-8a50-b74b21cb3a27', '64cb6dbe-77ab-4458-916c-bc48f7a070eb', '1eba4c9e-915b-4e62-9f78-e524a05f8c75'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Delete snapshot completed successfully. Jul 06 15:35:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d5c6e6a9-15b6-4801-b514-ce9f0b2a30ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-6aa127e5-74dc-45c3-9534-6be3830a4636-delete_snapshot" released by "delete_snapshot" :: held 4.072s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "cinder-2711500a-c6fd-4afc-8bfd-9c75ff05490d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:26 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-560eb440-b3df-4e49-a523-ac882a2c9aac" returned: 0 in 0.848s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:26 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8b301508-6a60-46fb-90e4-57c557099bf6" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-560eb440-b3df-4e49-a523-ac882a2c9aac" released by "delete_volume" :: held 3.052s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-2711500a-c6fd-4afc-8bfd-9c75ff05490d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-8b301508-6a60-46fb-90e4-57c557099bf6" released by "delete_volume" :: held 1.973s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "cinder-quobyte-2711500a-c6fd-4afc-8bfd-9c75ff05490d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-quobyte-2711500a-c6fd-4afc-8bfd-9c75ff05490d" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Created reservations ['280e7617-94af-475d-b250-27dae4ab1d61', '69ce60ba-90e0-444a-a29b-2cba5e14c780', '18e3f02e-1da7-462f-85fc-094659ae2928', 'b639293b-bbf7-4362-99dc-f91e503e160d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[274cadac-afc0-4253-8437-d7109f179d18]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['d63f5faf-cce4-4f04-9540-ef6713e66155'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:26 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d Jul 06 15:35:26 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:26 devstack cinder-volume[86191]: WARNING cinder.db.api [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-931748430'] Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['e7acdda8-7cae-4f90-bdc6-d1dd75fe8982', 'bbf1c432-565f-4001-8de3-37eb5bb05cf7', '47d10ec0-c445-47bb-ae15-ada0cc81a00f', 'bb5338f0-a204-4243-b21e-615740679f6a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:26 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:26 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:26 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:26 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:27 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.961s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Deleted volume successfully. Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d91121fd-f143-46b7-82df-cb0f30e1f672 tempest-VolumesExtendTest-385084564 None] Lock "cinder-560eb440-b3df-4e49-a523-ac882a2c9aac-delete_volume" released by "delete_volume" :: held 4.431s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:27 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d" returned: 0 in 1.151s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:27 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d Jul 06 15:35:27 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cb59a353-6f88-4f3c-bbab-a438e3b28362 tempest-GroupSnapshotsTest-1944361660 None] Group tempest-GroupSnapshotsTest-Group-1798302500: creating Jul 06 15:35:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cb59a353-6f88-4f3c-bbab-a438e3b28362 tempest-GroupSnapshotsTest-1944361660 None] Group tempest-GroupSnapshotsTest-Group-1798302500: created successfully Jul 06 15:35:27 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cb59a353-6f88-4f3c-bbab-a438e3b28362 tempest-GroupSnapshotsTest-1944361660 None] Create group completed successfully. Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.084s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:27 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-114142d6-caa7-4a63-9d4a-434071399690 tempest-GroupSnapshotsTest-1944361660 None] Delete group completed successfully. Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Flow 'volume_create_manager' (8e53cc0a-2b4a-42d7-b682-443414188649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81917bf-7c9b-408c-9c71-bf29b45b5f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81917bf-7c9b-408c-9c71-bf29b45b5f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1146245472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8547a747-5c6f-4d63-85f2-9adea3bf2110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d4be3257754e2a92e2a420c43eb555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:28Z,use_quota=True,user_id='239f129a1bae4d55bcb68bf98552f4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61b00ec-7c3d-4c69-9852-0a0e1bb31a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61b00ec-7c3d-4c69-9852-0a0e1bb31a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40afe5e7-b004-4cf9-a8d9-c43bde8224fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40afe5e7-b004-4cf9-a8d9-c43bde8224fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8547a747-5c6f-4d63-85f2-9adea3bf2110', 'volume_name': 'volume-8547a747-5c6f-4d63-85f2-9adea3bf2110', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bbba97-7026-4896-9df6-7497b4cb6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bbba97-7026-4896-9df6-7497b4cb6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf05e78-38fc-4e8e-8bae-1b49f0b46eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Volume 8547a747-5c6f-4d63-85f2-9adea3bf2110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8547a747-5c6f-4d63-85f2-9adea3bf2110', 'volume_size': 1} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1146245472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8547a747-5c6f-4d63-85f2-9adea3bf2110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d4be3257754e2a92e2a420c43eb555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:28Z,use_quota=True,user_id='239f129a1bae4d55bcb68bf98552f4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Creating volume 8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:28 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:28 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 1073741824 Jul 06 15:35:28 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:28 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2711500a-c6fd-4afc-8bfd-9c75ff05490d" returned: 0 in 0.740s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-quobyte-2711500a-c6fd-4afc-8bfd-9c75ff05490d" released by "delete_volume" :: held 1.965s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Created reservations ['3d2db57f-803f-4016-9cba-a515f7f395d5', 'b58189bb-15c6-4632-aeb1-588a7c70b535', '3e8ac2ee-7d17-4376-ad66-8773ca0fcb27', 'f1febb3e-f31c-4264-b922-862d984acbc5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:28 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:28 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:29 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.137s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:29 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Deleted volume successfully. Jul 06 15:35:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64a96b97-a69c-461b-b783-1369c5a9f274 tempest-VolumeSnapshotQuotasNegativeTestJSON-1596104359 None] Lock "cinder-2711500a-c6fd-4afc-8bfd-9c75ff05490d-delete_volume" released by "delete_volume" :: held 3.416s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:29 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 1073741824" returned: 0 in 1.501s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:29 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 Jul 06 15:35:29 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (970ee474-c531-4772-b669-5ca08d383249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191cf817-9b65-435f-92b3-da51cb33327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191cf817-9b65-435f-92b3-da51cb33327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781737190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c413fba4-fa33-4615-bd71-14e137f837c9,host='devstack@QuobyteHD#QuobyteHD',id=539129f9-c6b8-40be-aec6-586d083ba81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:30Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e005355d-b194-4c16-bcf6-8729a9c0d2c0),volume_type_id=e005355d-b194-4c16-bcf6-8729a9c0d2c0)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caadc033-be32-43f5-8f62-a4721a9759a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caadc033-be32-43f5-8f62-a4721a9759a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912268a0-e61f-469c-8445-968491b7d3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (912268a0-e61f-469c-8445-968491b7d3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539129f9-c6b8-40be-aec6-586d083ba81b', 'volume_name': 'volume-539129f9-c6b8-40be-aec6-586d083ba81b', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d654d114-645d-44a1-a40f-46cb73093c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d654d114-645d-44a1-a40f-46cb73093c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff18511-ee55-484f-852a-50759bf592ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Volume 539129f9-c6b8-40be-aec6-586d083ba81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539129f9-c6b8-40be-aec6-586d083ba81b', 'volume_size': 1} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:30 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110" returned: 0 in 0.747s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.299s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c413fba4-fa33-4615-bd71-14e137f837c9,created_at=2026-07-06T13:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1781737190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c413fba4-fa33-4615-bd71-14e137f837c9,host='devstack@QuobyteHD#QuobyteHD',id=539129f9-c6b8-40be-aec6-586d083ba81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:30Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e005355d-b194-4c16-bcf6-8729a9c0d2c0),volume_type_id=e005355d-b194-4c16-bcf6-8729a9c0d2c0)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Creating volume 539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:30 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:30 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b 1073741824 Jul 06 15:35:30 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf05e78-38fc-4e8e-8bae-1b49f0b46eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8547a747-5c6f-4d63-85f2-9adea3bf2110', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7dc0165-8791-415c-a3b2-f2ca5b4f300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Volume volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 (8547a747-5c6f-4d63-85f2-9adea3bf2110): created successfully Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7dc0165-8791-415c-a3b2-f2ca5b4f300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Flow 'volume_create_manager' (8e53cc0a-2b4a-42d7-b682-443414188649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-393d07f8-4a25-42d4-b677-1ee5dbc29ff0 tempest-VolumesExtendTest-385084564 None] Created volume successfully. Jul 06 15:35:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b 1073741824" returned: 0 in 1.240s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:31 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:31 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b Jul 06 15:35:31 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:32 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b" returned: 0 in 0.912s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.176s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff18511-ee55-484f-852a-50759bf592ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539129f9-c6b8-40be-aec6-586d083ba81b', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b3c9d9-a88c-4ae3-ba4f-0dbf08bfa8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Creating offline snapshot eb2419fe-1dbd-4f69-944e-30ebb8b513cd of volume 8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:35:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Volume volume-539129f9-c6b8-40be-aec6-586d083ba81b (539129f9-c6b8-40be-aec6-586d083ba81b): created successfully Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b3c9d9-a88c-4ae3-ba4f-0dbf08bfa8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (970ee474-c531-4772-b669-5ca08d383249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd539216-cd95-4e6a-92ed-a914eaeb9b23]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0f282a71-9c69-4798-a38d-b14e48d0893e tempest-GroupSnapshotsTest-1944361660 None] Created volume successfully. Jul 06 15:35:33 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 Jul 06 15:35:33 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-326bde7e-df63-4d3b-bb2b-19a2f287e392 tempest-VolumesActionsTest-412347381 None] Acquiring lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20" by "attach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-326bde7e-df63-4d3b-bb2b-19a2f287e392 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20" acquired by "attach_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-326bde7e-df63-4d3b-bb2b-19a2f287e392 tempest-VolumesActionsTest-412347381 None] Attaching volume 7cd10617-28c1-40e8-a9e4-306655537b20 to instance 22b2e776-a8d7-4589-92c0-b490be3d1bad at mountpoint /dev/vdb on host None. Jul 06 15:35:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-326bde7e-df63-4d3b-bb2b-19a2f287e392 tempest-VolumesActionsTest-412347381 None] Attach volume completed successfully. Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-326bde7e-df63-4d3b-bb2b-19a2f287e392 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20" released by "attach_volume" :: held 0.116s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:34 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110" returned: 0 in 1.243s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:34 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd 1G Jul 06 15:35:34 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (8a1fe9bc-dcc4-46f6-a902-9878ff755277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f97c2a-9a5b-46a9-98ea-dff9acef3720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-12d3170d-47a4-40f7-8cf4-573993404d17 tempest-VolumesActionsTest-412347381 None] Acquiring lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-detach_volume" by "detach_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f97c2a-9a5b-46a9-98ea-dff9acef3720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1080904317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c413fba4-fa33-4615-bd71-14e137f837c9,host='devstack@QuobyteHD#QuobyteHD',id=0ccccb70-0f93-46e6-97ec-789750f03b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:35Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e005355d-b194-4c16-bcf6-8729a9c0d2c0),volume_type_id=e005355d-b194-4c16-bcf6-8729a9c0d2c0)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643d4d97-f9bb-4819-9971-2256f28647d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643d4d97-f9bb-4819-9971-2256f28647d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5ed139-32ef-4484-9f45-3b975c193848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d5ed139-32ef-4484-9f45-3b975c193848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ccccb70-0f93-46e6-97ec-789750f03b8a', 'volume_name': 'volume-0ccccb70-0f93-46e6-97ec-789750f03b8a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbb5d2b-7407-4af2-ad1e-66accacb3f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dbb5d2b-7407-4af2-ad1e-66accacb3f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbb6c85-f2c0-41e8-99de-5ddadc6b37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:34 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Volume 0ccccb70-0f93-46e6-97ec-789750f03b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ccccb70-0f93-46e6-97ec-789750f03b8a', 'volume_size': 1} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-12d3170d-47a4-40f7-8cf4-573993404d17 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-detach_volume" acquired by "detach_volume" :: waited 0.093s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-12d3170d-47a4-40f7-8cf4-573993404d17 tempest-VolumesActionsTest-412347381 None] Detaching volume 7cd10617-28c1-40e8-a9e4-306655537b20 from instance 22b2e776-a8d7-4589-92c0-b490be3d1bad. Jul 06 15:35:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-12d3170d-47a4-40f7-8cf4-573993404d17 tempest-VolumesActionsTest-412347381 None] Detach volume completed successfully. Jul 06 15:35:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-12d3170d-47a4-40f7-8cf4-573993404d17 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:35 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd 1G" returned: 0 in 1.146s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:35 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd Jul 06 15:35:35 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Flow 'volume_create_manager' (1221767f-0b92-4eb2-a805-365604751d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58eac8b-61ef-49b0-b5a9-36c2e5216ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f58eac8b-61ef-49b0-b5a9-36c2e5216ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-617545569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b1e8e3-e9ae-403c-938e-554bfb573378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d825330c6a7d4fcd9d49042a0ede6524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:36Z,use_quota=True,user_id='eec8972df55141f3b75e9ea60e2b118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cc42c2-2e14-4314-9c0f-8eba18576ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cc42c2-2e14-4314-9c0f-8eba18576ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af47a463-68fe-4a67-8a68-15090ad1aad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af47a463-68fe-4a67-8a68-15090ad1aad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b1e8e3-e9ae-403c-938e-554bfb573378', 'volume_name': 'volume-49b1e8e3-e9ae-403c-938e-554bfb573378', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b95d1f5-734c-4cb1-84df-6e8a6b14930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:36 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b95d1f5-734c-4cb1-84df-6e8a6b14930d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12204511-1cc9-4b00-b800-ba2479810912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:36 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Volume 49b1e8e3-e9ae-403c-938e-554bfb573378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b1e8e3-e9ae-403c-938e-554bfb573378', 'volume_size': 1} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd" returned: 0 in 0.966s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:36 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd is being set with open permissions: ugo+rw Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:36 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd Jul 06 15:35:36 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:36 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd" returned: 0 in 0.631s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:37 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info Jul 06 15:35:37 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:37 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:37 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info is being set with open permissions: ugo+rw Jul 06 15:35:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:37 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info Jul 06 15:35:37 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:38 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.info" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.602s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.517s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c413fba4-fa33-4615-bd71-14e137f837c9,created_at=2026-07-06T13:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1080904317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c413fba4-fa33-4615-bd71-14e137f837c9,host='devstack@QuobyteHD#QuobyteHD',id=0ccccb70-0f93-46e6-97ec-789750f03b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:35Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e005355d-b194-4c16-bcf6-8729a9c0d2c0),volume_type_id=e005355d-b194-4c16-bcf6-8729a9c0d2c0)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Creating volume 0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:38 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:35:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:38 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a 1073741824 Jul 06 15:35:38 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cd58210f-b81e-44f8-8c12-b690eaaa56c7 tempest-VolumesExtendTest-385084564 None] Create snapshot completed successfully Jul 06 15:35:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:39 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a 1073741824" returned: 0 in 0.938s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:39 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a Jul 06 15:35:39 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:40 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a" returned: 0 in 0.674s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.799s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-617545569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b1e8e3-e9ae-403c-938e-554bfb573378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d825330c6a7d4fcd9d49042a0ede6524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:36Z,use_quota=True,user_id='eec8972df55141f3b75e9ea60e2b118a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Creating volume 49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:35:40 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:40 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 1073741824 Jul 06 15:35:40 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbb6c85-f2c0-41e8-99de-5ddadc6b37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ccccb70-0f93-46e6-97ec-789750f03b8a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da295d6-8f2a-4f14-901d-36ce61a17718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Volume volume-0ccccb70-0f93-46e6-97ec-789750f03b8a (0ccccb70-0f93-46e6-97ec-789750f03b8a): created successfully Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da295d6-8f2a-4f14-901d-36ce61a17718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (8a1fe9bc-dcc4-46f6-a902-9878ff755277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2f7ea3c9-33b1-4363-8159-7dba333af546 tempest-GroupSnapshotsTest-1944361660 None] Created volume successfully. Jul 06 15:35:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a8e90d95-be53-4175-a05c-a60ec492474f tempest-GroupSnapshotsTest-1944361660 None] Update group completed successfully. Jul 06 15:35:41 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 1073741824" returned: 0 in 0.933s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:41 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 Jul 06 15:35:41 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:41 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378" returned: 0 in 0.638s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.519s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12204511-1cc9-4b00-b800-ba2479810912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b1e8e3-e9ae-403c-938e-554bfb573378', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34888892-b3bc-4a5b-8a87-d4b1219b3fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[53151a2d-25b0-4b92-8c46-e1431a0c338e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:41 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Volume volume-49b1e8e3-e9ae-403c-938e-554bfb573378 (49b1e8e3-e9ae-403c-938e-554bfb573378): created successfully Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34888892-b3bc-4a5b-8a87-d4b1219b3fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Flow 'volume_create_manager' (1221767f-0b92-4eb2-a805-365604751d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:41 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f85ad319-167d-4544-99ed-6b8764312350 tempest-SnapshotMetadataTestJSON-580311261 None] Created volume successfully. Jul 06 15:35:41 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 Jul 06 15:35:41 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9d3ed680-8948-4bfd-9330-761e217fd230 tempest-GroupSnapshotsTest-1944361660 None] Update group completed successfully. Jul 06 15:35:42 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110" returned: 0 in 0.848s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd 2G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd 2G" returned: 0 in 0.176s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.080s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.018s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Creating offline snapshot 354216e1-a288-4170-8516-f59b014f6000 of volume 49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0db1ae7-c8ff-4630-8688-83c6d7f019a7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a73d9fff-c7ac-427c-a42e-92be0ea63810 tempest-VolumesExtendTest-385084564 None] Extend volume completed successfully. Jul 06 15:35:42 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 Jul 06 15:35:42 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-098e63f8-711c-4f03-9653-1398faa28d05 tempest-GroupSnapshotsTest-1944361660 None] Update group completed successfully. Jul 06 15:35:43 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-eb2419fe-1dbd-4f69-944e-30ebb8b513cd-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:43 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 1G Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Lock "cinder-eb2419fe-1dbd-4f69-944e-30ebb8b513cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:43 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-quobyte-8547a747-5c6f-4d63-85f2-9adea3bf2110" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-8547a747-5c6f-4d63-85f2-9adea3bf2110" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-quobyte-eb2419fe-1dbd-4f69-944e-30ebb8b513cd" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-eb2419fe-1dbd-4f69-944e-30ebb8b513cd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Deleting offline snapshot eb2419fe-1dbd-4f69-944e-30ebb8b513cd of volume 8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] snapshot_file for this snap is: volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d0b048-e2e4-40ea-a3fa-89a161a18289]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:43 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd Jul 06 15:35:43 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6d5b948e-7c5c-44d1-aa1b-5127cc4135b7 tempest-GroupSnapshotsTest-1944361660 None] Update group completed successfully. Jul 06 15:35:44 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 1G" returned: 0 in 0.899s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b1e8e3-e9ae-403c-938e-554bfb573378 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:44 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b1e8e3-e9ae-403c-938e-554bfb573378 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 Jul 06 15:35:44 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:44 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd" returned: 0 in 0.794s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8547a747-5c6f-4d63-85f2-9adea3bf2110(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[35564b09-4c78-45ed-b067-069d5fd031ec]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:44 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 Jul 06 15:35:44 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49b1e8e3-e9ae-403c-938e-554bfb573378 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000" returned: 0 in 0.690s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:45 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 is being set with open permissions: ugo+rw Jul 06 15:35:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 Jul 06 15:35:45 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110" returned: 0 in 0.786s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd Jul 06 15:35:45 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000" returned: 0 in 0.677s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:45 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info Jul 06 15:35:45 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] GroupSnapshot 03599399-f797-4508-970f-bc5c465a7701: creating. Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Group snapshot 03599399-f797-4508-970f-bc5c465a7701: creating. {{(pid=86191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:46 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd" returned: 0 in 0.804s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:46 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd Jul 06 15:35:46 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:46 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info" returned: 0 in 0.648s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:46 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info is being set with open permissions: ugo+rw Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:46 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info Jul 06 15:35:46 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:46 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110.eb2419fe-1dbd-4f69-944e-30ebb8b513cd" returned: 0 in 0.627s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-eb2419fe-1dbd-4f69-944e-30ebb8b513cd" released by "_delete_snapshot" :: held 3.170s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-8547a747-5c6f-4d63-85f2-9adea3bf2110" released by "delete_snapshot" :: held 3.205s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:46 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Created reservations ['439f4634-faea-4f52-84ca-02732a5e8292', 'ae09076a-af9d-4a65-8760-4151b91121d3', 'cf223b43-0598-427f-a6ab-f1b954e14984', 'e28f77f9-f40c-43f8-b4b2-0dd0bc8ffe42'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Delete snapshot completed successfully. Jul 06 15:35:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80abf408-aa00-4eda-8942-0e0418c50835 tempest-VolumesExtendTest-385084564 None] Lock "cinder-eb2419fe-1dbd-4f69-944e-30ebb8b513cd-delete_snapshot" released by "delete_snapshot" :: held 3.344s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:47 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.info" returned: 0 in 0.671s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.461s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.493s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[78125b05-e978-4f83-892c-835c33e6b915]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6586d04b-5e82-452f-b56b-ee0c24489a89 tempest-SnapshotMetadataTestJSON-580311261 None] Create snapshot completed successfully Jul 06 15:35:47 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:35:47 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-8547a747-5c6f-4d63-85f2-9adea3bf2110-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Lock "cinder-8547a747-5c6f-4d63-85f2-9adea3bf2110-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Acquiring lock "cinder-quobyte-8547a747-5c6f-4d63-85f2-9adea3bf2110" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-8547a747-5c6f-4d63-85f2-9adea3bf2110" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:48 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.851s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f5837-d912-46e9-8fb7-54211a2e70b4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0208eb82-8347-4259-846c-aa3888df8dd1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:48 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:35:48 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:48 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 Jul 06 15:35:48 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "cinder-354216e1-a288-4170-8516-f59b014f6000-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-354216e1-a288-4170-8516-f59b014f6000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "cinder-quobyte-49b1e8e3-e9ae-403c-938e-554bfb573378" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-quobyte-49b1e8e3-e9ae-403c-938e-554bfb573378" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "cinder-quobyte-354216e1-a288-4170-8516-f59b014f6000" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-quobyte-354216e1-a288-4170-8516-f59b014f6000" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Deleting offline snapshot 354216e1-a288-4170-8516-f59b014f6000 of volume 49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] snapshot_file for this snap is: volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5006a443-680d-497f-b858-5802f28c1359]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:48 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.825s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0de19501-7db1-4cf4-a20c-277642daf82f55ufrxs6.img {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:49 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 Jul 06 15:35:49 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:49 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110" returned: 0 in 0.829s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:49 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0de19501-7db1-4cf4-a20c-277642daf82f55ufrxs6.img Jul 06 15:35:49 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:49 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110 Jul 06 15:35:49 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:49 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000" returned: 0 in 0.783s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49b1e8e3-e9ae-403c-938e-554bfb573378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:35:49 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8547a747-5c6f-4d63-85f2-9adea3bf2110" returned: 0 in 0.690s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aab00f-d111-4cbf-bccb-2aa9e42703ae]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Lock "cinder-quobyte-8547a747-5c6f-4d63-85f2-9adea3bf2110" released by "delete_volume" :: held 1.677s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=126,cinder:INSERT=38,cinder:UPDATE=138,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:35:49 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=115,cinder:SELECT=138,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:35:50 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 Jul 06 15:35:50 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Created reservations ['84464f13-b236-4160-9749-1e142cffd240', '5bd89194-b670-4e8e-a930-cfbccaae11b2', '6769c457-d2da-42a1-a42b-a88aa299f133', 'ea9c6edf-0e8e-45d8-84aa-f72f245a8555'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:50 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:50 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:51 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378" returned: 0 in 1.284s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:51 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 Jul 06 15:35:51 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:52 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 2.030s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:52 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Deleted volume successfully. Jul 06 15:35:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0132e448-7a6b-4c0b-8c46-0441401be35f tempest-VolumesExtendTest-385084564 None] Lock "cinder-8547a747-5c6f-4d63-85f2-9adea3bf2110-delete_volume" released by "delete_volume" :: held 4.306s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:53 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000" returned: 0 in 2.685s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:53 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000 Jul 06 15:35:53 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:54 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378.354216e1-a288-4170-8516-f59b014f6000" returned: 0 in 0.963s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:54 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0de19501-7db1-4cf4-a20c-277642daf82f55ufrxs6.img" returned: 0 in 5.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4253ddb-0c91-4157-ae13-df36be074f03]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-quobyte-354216e1-a288-4170-8516-f59b014f6000" released by "_delete_snapshot" :: held 5.879s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-quobyte-49b1e8e3-e9ae-403c-938e-554bfb573378" released by "delete_snapshot" :: held 5.909s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Created reservations ['faacafaf-e489-44d6-afc3-8f7dfbf7c113', '8d75a26a-8280-46c8-adc3-87f81e515063', '63da3195-1000-4951-8647-c1522e93a01b', '8a299ddf-02e4-4e3e-b589-2179b4737131'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:54 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:35:54 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Delete snapshot completed successfully. Jul 06 15:35:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b48133fe-6568-4229-9f68-8de1f007707d tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-354216e1-a288-4170-8516-f59b014f6000-delete_snapshot" released by "delete_snapshot" :: held 6.064s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "cinder-49b1e8e3-e9ae-403c-938e-554bfb573378-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-49b1e8e3-e9ae-403c-938e-554bfb573378-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "cinder-quobyte-49b1e8e3-e9ae-403c-938e-554bfb573378" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-quobyte-49b1e8e3-e9ae-403c-938e-554bfb573378" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c92962-2803-4294-9532-194f03c53a43]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:55 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 Jul 06 15:35:55 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:55 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 1.022s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0de19501-7db1-4cf4-a20c-277642daf82f55ufrxs6.img {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:35:55 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Converted 1024.00 MB image at 180.29 MB/s Jul 06 15:35:55 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] 0de19501-7db1-4cf4-a20c-277642daf82f was raw, no need to convert to raw {{(pid=86191) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 15:35:56 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378" returned: 0 in 0.848s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:56 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378 Jul 06 15:35:56 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:57 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-49b1e8e3-e9ae-403c-938e-554bfb573378" returned: 0 in 0.757s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-quobyte-49b1e8e3-e9ae-403c-938e-554bfb573378" released by "delete_volume" :: held 1.671s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Created reservations ['60b8431a-fa72-41aa-af37-670caaf075ec', 'd8cb9e59-683f-4898-abd0-7045fd5d16af', 'e81e4d94-9a05-4594-a5e7-f5072e97e9be', '896366cb-93a8-4373-9daf-2e2651841c71'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:35:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:35:57 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:35:57 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:35:58 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 06 15:35:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.866s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:35:58 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:35:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Deleted volume successfully. Jul 06 15:35:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e4d9eed5-dc1d-40ad-9653-f96a5a4f1696 tempest-SnapshotMetadataTestJSON-580311261 None] Lock "cinder-49b1e8e3-e9ae-403c-938e-554bfb573378-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Flow 'volume_create_manager' (0d0d5af6-b824-4a12-b06b-c6986c00e3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72db8f7b-7f11-40b8-8638-5e73d60f7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72db8f7b-7f11-40b8-8638-5e73d60f7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-359558930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067395f5-9191-4391-8140-a53428780bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa63bd99fa04431a9b25b65fc4815e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:59Z,use_quota=True,user_id='005e4d2b01f748d2a6c23442fd42b425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e296f895-8713-48d2-b23e-8cd57f65363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e296f895-8713-48d2-b23e-8cd57f65363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932a3ab8-85fc-48d6-a000-0b731fb2553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932a3ab8-85fc-48d6-a000-0b731fb2553a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067395f5-9191-4391-8140-a53428780bfd', 'volume_name': 'volume-067395f5-9191-4391-8140-a53428780bfd', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44eafe1-e873-471e-a11d-0a384792bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44eafe1-e873-471e-a11d-0a384792bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c36ab8-6bee-4c7b-9d3a-1ec74f735e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:35:59 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Volume 067395f5-9191-4391-8140-a53428780bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067395f5-9191-4391-8140-a53428780bfd', 'volume_size': 1} Jul 06 15:35:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Flow 'volume_create_manager' (2379a434-4a6d-4178-8037-f0f8e3c9caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0685d1-c114-41c0-9f6d-20339252c8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0685d1-c114-41c0-9f6d-20339252c8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-250386452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd286c8-cfab-4585-af73-782d335ece7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19e106b2c14aeda36e38b10f513e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:01Z,use_quota=True,user_id='8701e0450a324f5a84431eb779cb07bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5311b17d-d7c1-4d60-95f5-ec987a84c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5311b17d-d7c1-4d60-95f5-ec987a84c700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3b8e5f-79d4-42e0-ae74-612b2ec95cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3b8e5f-79d4-42e0-ae74-612b2ec95cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd286c8-cfab-4585-af73-782d335ece7d', 'volume_name': 'volume-6bd286c8-cfab-4585-af73-782d335ece7d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a543ec2-1caa-492f-9b91-3d396d50f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a543ec2-1caa-492f-9b91-3d396d50f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07cf371-900f-4758-8878-ac79844d85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Volume 6bd286c8-cfab-4585-af73-782d335ece7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd286c8-cfab-4585-af73-782d335ece7d', 'volume_size': 1} Jul 06 15:36:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:06 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:06 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:07 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.659s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:36:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:36:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:36:11 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=20,cinder:SELECT=16,cinder:DELETE=1,cinder:INSERT=4 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:36:11 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=17,cinder:INSERT=8,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:36:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.444s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Uploaded volume to glance image-id: 0de19501-7db1-4cf4-a20c-277642daf82f. {{(pid=86191) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 15:36:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.723s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Creating offline snapshot 44922248-ec72-49e7-8c8e-e850d7f67854 of volume 0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6a6241ee-518e-4515-be01-70b9f0cbbdcb tempest-VolumesActionsTest-412347381 None] Copy volume to image completed successfully. Jul 06 15:36:15 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[447733e4-17bd-44e7-8f7a-fa70f3bbb287]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:15 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a Jul 06 15:36:15 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:16 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a" returned: 0 in 0.818s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:16 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 1G Jul 06 15:36:16 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:17 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 1G" returned: 0 in 0.764s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccccb70-0f93-46e6-97ec-789750f03b8a -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:17 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccccb70-0f93-46e6-97ec-789750f03b8a -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 Jul 06 15:36:17 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:18 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ccccb70-0f93-46e6-97ec-789750f03b8a -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854" returned: 0 in 0.649s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:18 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:18 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 Jul 06 15:36:18 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:18 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854" returned: 0 in 0.600s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:18 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info Jul 06 15:36:18 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:19 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info" returned: 0 in 0.618s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:19 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:19 devstack sudo[97201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info Jul 06 15:36:19 devstack sudo[97201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:19 devstack sudo[97201]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.info" returned: 0 in 0.602s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.140s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Creating offline snapshot de618fb5-20f3-4e17-884d-ec3459430d9e of volume 539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[947dfb19-1c5f-4d50-8013-5b186d443f8c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:20 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b Jul 06 15:36:20 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:20 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b" returned: 0 in 0.716s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:20 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e 1G Jul 06 15:36:20 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:21 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e 1G" returned: 0 in 0.752s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-539129f9-c6b8-40be-aec6-586d083ba81b -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:21 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-539129f9-c6b8-40be-aec6-586d083ba81b -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e Jul 06 15:36:21 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:22 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-539129f9-c6b8-40be-aec6-586d083ba81b -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e" returned: 0 in 0.643s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:22 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:22 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e Jul 06 15:36:22 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:22 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e" returned: 0 in 0.596s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:22 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info Jul 06 15:36:22 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:23 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info" returned: 0 in 0.597s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:23 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:23 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info Jul 06 15:36:23 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:23 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.info" returned: 0 in 0.624s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.728s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-250386452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd286c8-cfab-4585-af73-782d335ece7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19e106b2c14aeda36e38b10f513e5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:01Z,use_quota=True,user_id='8701e0450a324f5a84431eb779cb07bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Creating volume 6bd286c8-cfab-4585-af73-782d335ece7d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:23 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:23 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d 1073741824 Jul 06 15:36:23 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f19ecf35-c1b6-4bd2-8170-85596a34ff58 tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 03599399-f797-4508-970f-bc5c465a7701: created successfully Jul 06 15:36:24 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d 1073741824" returned: 0 in 0.772s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:24 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d Jul 06 15:36:24 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 03599399-f797-4508-970f-bc5c465a7701: deleting Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 03599399-f797-4508-970f-bc5c465a7701: deleting {{(pid=86191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-0ccccb70-0f93-46e6-97ec-789750f03b8a" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-0ccccb70-0f93-46e6-97ec-789750f03b8a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-44922248-ec72-49e7-8c8e-e850d7f67854" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-44922248-ec72-49e7-8c8e-e850d7f67854" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Deleting offline snapshot 44922248-ec72-49e7-8c8e-e850d7f67854 of volume 0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:36:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] snapshot_file for this snap is: volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[94004105-38d6-413b-94b6-5e872a105f8c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:25 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 Jul 06 15:36:25 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:25 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d" returned: 0 in 0.641s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.256s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07cf371-900f-4758-8878-ac79844d85a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd286c8-cfab-4585-af73-782d335ece7d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691cbc8b-c0b0-4ba5-acd2-0f83dcf67fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[95766b51-536f-4a88-b721-f5273131f2fe]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Volume volume-6bd286c8-cfab-4585-af73-782d335ece7d (6bd286c8-cfab-4585-af73-782d335ece7d): created successfully Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (691cbc8b-c0b0-4ba5-acd2-0f83dcf67fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Flow 'volume_create_manager' (2379a434-4a6d-4178-8037-f0f8e3c9caca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-11eacf77-ee9f-4eac-ad6f-8ff8d00b73c8 tempest-VolumesMetadataTest-1313292112 None] Created volume successfully. Jul 06 15:36:25 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:36:25 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:25 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ccccb70-0f93-46e6-97ec-789750f03b8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79090a-f0c6-42ef-a043-698fbcf758e9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:25 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a Jul 06 15:36:25 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:26 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.811s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b040b4d3-e07b-4e10-9707-ab6a43104f2a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Acquiring lock "cinder-6bd286c8-cfab-4585-af73-782d335ece7d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Lock "cinder-6bd286c8-cfab-4585-af73-782d335ece7d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Acquiring lock "cinder-quobyte-6bd286c8-cfab-4585-af73-782d335ece7d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Lock "cinder-quobyte-6bd286c8-cfab-4585-af73-782d335ece7d" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:26 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:36:26 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c3265-5f15-4e2e-87bd-056b08679af1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:26 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d Jul 06 15:36:26 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:26 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a" returned: 0 in 0.820s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:26 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 Jul 06 15:36:26 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:27 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.827s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:27 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img Jul 06 15:36:27 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:27 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:27 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d Jul 06 15:36:27 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:27 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854" returned: 0 in 0.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:27 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854 Jul 06 15:36:27 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:28 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6bd286c8-cfab-4585-af73-782d335ece7d" returned: 0 in 1.136s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Lock "cinder-quobyte-6bd286c8-cfab-4585-af73-782d335ece7d" released by "delete_volume" :: held 1.978s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Created reservations ['44e62885-2ad1-46ba-93cb-bc6ed68ae57b', '434f6104-8aad-4a59-87bf-99923fa29525', '9d40ce77-824b-4794-bb62-0b3cbaac34ec', 'e988d270-0ef3-41b9-9471-110154a74185'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:28 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:28 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:29 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a.44922248-ec72-49e7-8c8e-e850d7f67854" returned: 0 in 1.901s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-44922248-ec72-49e7-8c8e-e850d7f67854" released by "_delete_snapshot" :: held 4.493s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-0ccccb70-0f93-46e6-97ec-789750f03b8a" released by "delete_snapshot" :: held 4.527s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-539129f9-c6b8-40be-aec6-586d083ba81b" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-539129f9-c6b8-40be-aec6-586d083ba81b" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-de618fb5-20f3-4e17-884d-ec3459430d9e" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-de618fb5-20f3-4e17-884d-ec3459430d9e" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Deleting offline snapshot de618fb5-20f3-4e17-884d-ec3459430d9e of volume 539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] snapshot_file for this snap is: volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e400a96-586e-403b-bf46-92a2ba71b1d6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:30 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e Jul 06 15:36:30 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:30 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.691s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:30 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Deleted volume successfully. Jul 06 15:36:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cfd5da34-887c-47cd-a82f-45114554b2bd tempest-VolumesMetadataTest-1313292112 None] Lock "cinder-6bd286c8-cfab-4585-af73-782d335ece7d-delete_volume" released by "delete_volume" :: held 4.117s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:31 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e" returned: 0 in 1.472s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-539129f9-c6b8-40be-aec6-586d083ba81b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[635efe75-2eb4-4a3d-b329-9865b6acd302]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:31 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b Jul 06 15:36:31 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:32 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img" returned: 0 in 5.649s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:32 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b" returned: 0 in 1.410s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[830492de-a09a-40ec-8f22-fa93299b5918]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:32 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e Jul 06 15:36:32 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:32 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:36:32 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:33 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e" returned: 0 in 0.838s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:33 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e Jul 06 15:36:33 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:33 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 1.101s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:36:33 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Converted 1024.00 MB image at 181.24 MB/s Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] 0a625b20-a39e-4ba3-be66-27d593a94834 was raw, converting to qcow2 {{(pid=86191) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c29dbdd-fc18-475c-9a0e-30bef0474c0f]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:33 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img Jul 06 15:36:33 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:34 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b.de618fb5-20f3-4e17-884d-ec3459430d9e" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-de618fb5-20f3-4e17-884d-ec3459430d9e" released by "_delete_snapshot" :: held 4.614s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-539129f9-c6b8-40be-aec6-586d083ba81b" released by "delete_snapshot" :: held 4.667s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:34 devstack cinder-volume[86191]: WARNING cinder.quota [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1573407406 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1573407406, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:34 devstack cinder-volume[86191]: WARNING cinder.quota [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1573407406 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1573407406, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['15014cf8-3e66-4793-b741-dec29b7edcaf', '4c73e15c-0377-4dc6-a6d7-5aa3a78b5e8a', '8bfa1823-0f08-47a8-aaf5-85f5530d0760', 'cacca671-a04d-4d9f-abe0-b6a1909b5490'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['4383e902-6a85-44d0-a2f8-73e13a021856', 'abdd9f46-744b-4e0e-9b52-5ff30ceb3b01', '0ba0ce33-d7bd-4a7c-8e81-7e64053370d9', 'd5c17d75-c8f1-4205-b43c-d0b252ba080a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fa946b28-09fd-49d2-8f52-cf452a98366f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 03599399-f797-4508-970f-bc5c465a7701: deleted successfully Jul 06 15:36:34 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img" returned: 0 in 0.836s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:34 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img Jul 06 15:36:34 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-0ccccb70-0f93-46e6-97ec-789750f03b8a" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-0ccccb70-0f93-46e6-97ec-789750f03b8a" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0315930e-a78b-406d-9f2b-979fcc50856f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:35 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a Jul 06 15:36:35 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:35 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img" returned: 1 in 0.784s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:36:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:35 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx Jul 06 15:36:35 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:36 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a" returned: 0 in 0.829s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:36 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a Jul 06 15:36:36 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:36 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx" returned: 0 in 0.717s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Image conversion details: src /opt/stack/data/cinder/conversion/7cd10617-28c1-40e8-a9e4-306655537b20.temp_image.0a625b20-a39e-4ba3-be66-27d593a94834wxzga6x0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:36:36 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6af0f7-fe09-4722-b6ad-f632aae1fcda]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:36 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx Jul 06 15:36:36 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Flow 'volume_create_manager' (147b589d-b1c2-4317-9318-a1f75e7daeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd0be6c-9c01-4854-a970-e3b90480b27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd0be6c-9c01-4854-a970-e3b90480b27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1432549314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee83ffc-ff8f-4373-b3aa-3a708157f31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0663dd3210948d297242deb3c9da019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:36Z,use_quota=True,user_id='22c57a845e7c46dc870c671864e5e601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1e1ec2-7a55-4bb4-903e-1aa2d067a4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1e1ec2-7a55-4bb4-903e-1aa2d067a4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6762ab7c-ba02-40a1-a161-5ad808901f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6762ab7c-ba02-40a1-a161-5ad808901f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ee83ffc-ff8f-4373-b3aa-3a708157f31c', 'volume_name': 'volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a057d6-f6b9-45e4-8ef1-82a275bc3ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a057d6-f6b9-45e4-8ef1-82a275bc3ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be2d3ae-e8a2-4db9-98a7-f7532615ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:36 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Volume 5ee83ffc-ff8f-4373-b3aa-3a708157f31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c', 'volume_size': 1} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:36 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0ccccb70-0f93-46e6-97ec-789750f03b8a" returned: 0 in 0.704s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-0ccccb70-0f93-46e6-97ec-789750f03b8a" released by "delete_volume" :: held 1.618s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-539129f9-c6b8-40be-aec6-586d083ba81b" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-539129f9-c6b8-40be-aec6-586d083ba81b" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5be0f05-992c-4eb2-a54b-41600e7fa44f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:36 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e9w5ldhx" returned: 0 in 0.789s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:37 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b Jul 06 15:36:37 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:37 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:37 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b Jul 06 15:36:37 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:38 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-539129f9-c6b8-40be-aec6-586d083ba81b" returned: 0 in 0.643s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-539129f9-c6b8-40be-aec6-586d083ba81b" released by "delete_volume" :: held 1.490s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['36415e84-fdce-44ee-8dd7-d60adde9d4b2'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.118s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Uploaded volume to glance image-id: 0a625b20-a39e-4ba3-be66-27d593a94834. {{(pid=86191) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 39.062s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-359558930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067395f5-9191-4391-8140-a53428780bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa63bd99fa04431a9b25b65fc4815e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:35:59Z,use_quota=True,user_id='005e4d2b01f748d2a6c23442fd42b425',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Creating volume 067395f5-9191-4391-8140-a53428780bfd {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:38 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:38 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd 1073741824 Jul 06 15:36:38 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:38 devstack cinder-volume[86191]: WARNING cinder.quota [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1573407406 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1573407406, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0b926ca1-b8ac-4809-91c1-6b743d86cca3 tempest-VolumesActionsTest-412347381 None] Copy volume to image completed successfully. Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['b5c64bf9-247b-4fbd-9a74-e67dfbed8290', 'a02999cc-a2d9-4a59-8ff7-d19dcf2132a9', '18e90fc2-b61e-49ac-ae47-c44a6d47f334', 'b2802379-3860-4f66-9fc2-87491aa69828'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['59ef9844-a02b-4e09-b13f-6d84d156fe95', '9c469005-91e9-4e1f-b05b-cac76cfac553', '490322ff-47d7-414c-be4a-40ddfa99e5d9', 'b7aebc99-e2dc-4a47-a20a-78a812e0973b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:38 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:38 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1faf13b5-0ec9-44c3-97c9-77612b129663 tempest-GroupSnapshotsTest-1944361660 None] Group tempest-GroupSnapshotsTest-Group-669547956: creating Jul 06 15:36:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1faf13b5-0ec9-44c3-97c9-77612b129663 tempest-GroupSnapshotsTest-1944361660 None] Group tempest-GroupSnapshotsTest-Group-669547956: created successfully Jul 06 15:36:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1faf13b5-0ec9-44c3-97c9-77612b129663 tempest-GroupSnapshotsTest-1944361660 None] Create group completed successfully. Jul 06 15:36:39 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd 1073741824" returned: 0 in 1.000s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:39 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd Jul 06 15:36:39 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:39 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.802s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-15a66fff-1c43-41c8-91f8-cf3d78f81b4c tempest-GroupSnapshotsTest-1944361660 None] Delete group completed successfully. Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Acquiring lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Acquiring lock "cinder-quobyte-7cd10617-28c1-40e8-a9e4-306655537b20" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Lock "cinder-quobyte-7cd10617-28c1-40e8-a9e4-306655537b20" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb52b99b-2689-4916-8453-2accd3cd5f66]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:40 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:36:40 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:40 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd" returned: 0 in 0.721s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1432549314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ee83ffc-ff8f-4373-b3aa-3a708157f31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0663dd3210948d297242deb3c9da019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:36Z,use_quota=True,user_id='22c57a845e7c46dc870c671864e5e601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Creating volume 5ee83ffc-ff8f-4373-b3aa-3a708157f31c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:40 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c36ab8-6bee-4c7b-9d3a-1ec74f735e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067395f5-9191-4391-8140-a53428780bfd', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04b7563-8fba-4567-9052-ef9379424284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:40 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c 1073741824 Jul 06 15:36:40 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Volume volume-067395f5-9191-4391-8140-a53428780bfd (067395f5-9191-4391-8140-a53428780bfd): created successfully Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04b7563-8fba-4567-9052-ef9379424284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Flow 'volume_create_manager' (0d0d5af6-b824-4a12-b06b-c6986c00e3be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-98483383-f7fc-4ec9-b1c6-7ea6d5b4781c tempest-VolumesNegativeTest-1017420926 None] Created volume successfully. Jul 06 15:36:40 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.922s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:40 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20 Jul 06 15:36:40 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (507fec4d-6496-482f-80d7-a43e0d0ab0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b603154a-caf1-42bc-bf92-34d4e391c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b603154a-caf1-42bc-bf92-34d4e391c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-422228807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e052012-2314-441d-a5e1-53436451b3de,host='devstack@QuobyteHD#QuobyteHD',id=c90394fe-e195-4116-bb5c-18aae55da970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:41Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e31e05c3-f59e-4bec-9683-5dff9aefe102),volume_type_id=e31e05c3-f59e-4bec-9683-5dff9aefe102)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0273fbe2-576e-4142-81bd-e908f0b89ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0273fbe2-576e-4142-81bd-e908f0b89ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c71d2c3-cd12-4e99-a11e-7336c0cf67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c71d2c3-cd12-4e99-a11e-7336c0cf67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90394fe-e195-4116-bb5c-18aae55da970', 'volume_name': 'volume-c90394fe-e195-4116-bb5c-18aae55da970', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d8eabc-e3a9-44fa-8f73-a48331e8df0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d8eabc-e3a9-44fa-8f73-a48331e8df0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdcc17b-3746-414f-8df7-8a33da2645d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:41 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Volume c90394fe-e195-4116-bb5c-18aae55da970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90394fe-e195-4116-bb5c-18aae55da970', 'volume_size': 1} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:41 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c 1073741824" returned: 0 in 1.058s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:41 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c Jul 06 15:36:41 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:41 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7cd10617-28c1-40e8-a9e4-306655537b20" returned: 0 in 0.737s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Lock "cinder-quobyte-7cd10617-28c1-40e8-a9e4-306655537b20" released by "delete_volume" :: held 1.713s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Created reservations ['180475d4-682f-450e-bf3b-186797ca2459', '0613abf3-f0f6-4f05-94b2-334346b0f8f9', '9db39c66-9c20-44b7-b63a-d52ab74a3282', 'ed9c25cc-88c0-4f06-a344-b066acae8eab'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:41 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:41 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:42 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c" returned: 0 in 0.718s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5e052012-2314-441d-a5e1-53436451b3de,created_at=2026-07-06T13:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-422228807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5e052012-2314-441d-a5e1-53436451b3de,host='devstack@QuobyteHD#QuobyteHD',id=c90394fe-e195-4116-bb5c-18aae55da970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111905522de14b8a878feadc679b362a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:41Z,use_quota=True,user_id='6035121e03514bab90a904d78b4fd858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e31e05c3-f59e-4bec-9683-5dff9aefe102),volume_type_id=e31e05c3-f59e-4bec-9683-5dff9aefe102)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Creating volume c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:42 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be2d3ae-e8a2-4db9-98a7-f7532615ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:42 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 1073741824 Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edd9dd5-1de9-4bca-8188-e149dd81b227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:42 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Volume volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c (5ee83ffc-ff8f-4373-b3aa-3a708157f31c): created successfully Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0edd9dd5-1de9-4bca-8188-e149dd81b227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Flow 'volume_create_manager' (147b589d-b1c2-4317-9318-a1f75e7daeb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-60a2182f-bd2d-4cae-b372-179bee899fca tempest-VolumesTransfersV355Test-1203911821 None] Created volume successfully. Jul 06 15:36:42 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.836s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Deleted volume successfully. Jul 06 15:36:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6ff84355-cf1c-46ad-9ac0-0806e1b27a52 tempest-VolumesActionsTest-412347381 None] Lock "cinder-7cd10617-28c1-40e8-a9e4-306655537b20-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:43 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 1073741824" returned: 0 in 1.143s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:43 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 Jul 06 15:36:43 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f7b0feb8-0421-46f1-b717-681e488e7784 tempest-VolumesTransfersV355Test-1861819155 None] Transfer volume completed successfully. Jul 06 15:36:44 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970" returned: 0 in 0.832s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdcc17b-3746-414f-8df7-8a33da2645d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90394fe-e195-4116-bb5c-18aae55da970', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3605b1e2-196d-43ca-bebe-6f078e0dca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Volume volume-c90394fe-e195-4116-bb5c-18aae55da970 (c90394fe-e195-4116-bb5c-18aae55da970): created successfully Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3605b1e2-196d-43ca-bebe-6f078e0dca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Flow 'volume_create_manager' (507fec4d-6496-482f-80d7-a43e0d0ab0c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b1148fe5-2f73-4f01-96f4-af3a8f459e61 tempest-GroupSnapshotsTest-1944361660 None] Created volume successfully. Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Acquiring lock "cinder-5ee83ffc-ff8f-4373-b3aa-3a708157f31c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-5ee83ffc-ff8f-4373-b3aa-3a708157f31c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Acquiring lock "cinder-quobyte-5ee83ffc-ff8f-4373-b3aa-3a708157f31c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-quobyte-5ee83ffc-ff8f-4373-b3aa-3a708157f31c" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e857a3df-844c-47c7-991c-c6274edf0c77]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:44 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c Jul 06 15:36:44 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] GroupSnapshot 8d47e998-fdf9-42e7-bd64-84bef0e3d1ab: creating. Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Group snapshot 8d47e998-fdf9-42e7-bd64-84bef0e3d1ab: creating. {{(pid=86191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Creating offline snapshot 7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 of volume c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db28e70-2211-47bc-b3c9-89d2be453a7a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:45 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 Jul 06 15:36:45 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:45 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c" returned: 0 in 0.954s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:45 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c Jul 06 15:36:45 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:46 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970" returned: 0 in 0.944s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:46 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 1G Jul 06 15:36:46 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:46 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ee83ffc-ff8f-4373-b3aa-3a708157f31c" returned: 0 in 0.816s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-quobyte-5ee83ffc-ff8f-4373-b3aa-3a708157f31c" released by "delete_volume" :: held 1.824s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Created reservations ['95670b02-01e4-47f9-9774-5891acd1aacc', 'f294a710-9cdf-4217-a4cd-f06ac259d8bd', 'ed716174-bfb0-433e-9fd7-3c7749b9a470', 'ffe1b54f-b7fa-4d42-a9a0-ac6d0a9baa86'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:46 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:46 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:47 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 1G" returned: 0 in 0.990s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90394fe-e195-4116-bb5c-18aae55da970 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:47 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90394fe-e195-4116-bb5c-18aae55da970 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 Jul 06 15:36:47 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:47 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.891s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Deleted volume successfully. Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a8aca3a7-2052-4d0d-9483-395b3bc1b5ea tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-5ee83ffc-ff8f-4373-b3aa-3a708157f31c-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Flow 'volume_create_manager' (b32387d3-b95a-4e69-93ed-8c2bf52852a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363e91e3-a669-4476-81e5-fa0ccd23b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363e91e3-a669-4476-81e5-fa0ccd23b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-438288194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0663dd3210948d297242deb3c9da019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:48Z,use_quota=True,user_id='22c57a845e7c46dc870c671864e5e601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7f929e-d637-470e-a4a8-4eb18450838d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7f929e-d637-470e-a4a8-4eb18450838d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261dcdab-8c71-4e8c-9666-1d356775c661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261dcdab-8c71-4e8c-9666-1d356775c661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0', 'volume_name': 'volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92eb0108-4ddc-4d67-82be-4d92c452d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92eb0108-4ddc-4d67-82be-4d92c452d92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fadc1c-f72c-4ad0-974e-7ccee4f9a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Volume fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0', 'volume_size': 1} Jul 06 15:36:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:48 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90394fe-e195-4116-bb5c-18aae55da970 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" returned: 0 in 0.972s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:48 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:48 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 Jul 06 15:36:48 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:48 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" returned: 0 in 0.734s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:48 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info Jul 06 15:36:48 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (a6dc7a29-a24d-49bf-a68d-f2977ee35d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe58e9df-8bb5-434f-9b33-ad201a1d2480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe58e9df-8bb5-434f-9b33-ad201a1d2480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-961426913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9136e70e-777e-4a57-a1d2-c2dc08d7d064,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:50Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e005c7-2547-4820-be60-dd1363ceaedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e005c7-2547-4820-be60-dd1363ceaedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8625b92f-40f8-4297-b6ec-858068e01a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8625b92f-40f8-4297-b6ec-858068e01a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9136e70e-777e-4a57-a1d2-c2dc08d7d064', 'volume_name': 'volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a392b991-ca1a-4e89-9401-07ee3a52deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a392b991-ca1a-4e89-9401-07ee3a52deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434dece7-ad4b-44be-a948-72687b35d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Volume 9136e70e-777e-4a57-a1d2-c2dc08d7d064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064', 'volume_size': 1} Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:49 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info" returned: 0 in 0.994s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:49 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 15:36:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:49 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info Jul 06 15:36:49 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:50 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.info" returned: 0 in 0.704s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.435s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-438288194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0663dd3210948d297242deb3c9da019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:48Z,use_quota=True,user_id='22c57a845e7c46dc870c671864e5e601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Creating volume fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:50 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:50 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 1073741824 Jul 06 15:36:50 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c463f520-21c9-4277-9124-48afa8e2080c tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 8d47e998-fdf9-42e7-bd64-84bef0e3d1ab: created successfully Jul 06 15:36:51 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 1073741824" returned: 0 in 0.834s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:51 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 Jul 06 15:36:51 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 8d47e998-fdf9-42e7-bd64-84bef0e3d1ab: deleting Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 8d47e998-fdf9-42e7-bd64-84bef0e3d1ab: deleting {{(pid=86191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-c90394fe-e195-4116-bb5c-18aae55da970" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-c90394fe-e195-4116-bb5c-18aae55da970" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Deleting offline snapshot 7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 of volume c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] snapshot_file for this snap is: volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[94986316-b04c-47c0-b766-28494d3e79fe]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:51 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 Jul 06 15:36:51 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:52 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0" returned: 0 in 0.735s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-961426913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9136e70e-777e-4a57-a1d2-c2dc08d7d064,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:50Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Creating volume 9136e70e-777e-4a57-a1d2-c2dc08d7d064 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:52 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:52 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 1073741824 Jul 06 15:36:52 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fadc1c-f72c-4ad0-974e-7ccee4f9a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816d73b4-a057-4b87-9c2f-7c19046f9b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Volume volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 (fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0): created successfully Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816d73b4-a057-4b87-9c2f-7c19046f9b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Flow 'volume_create_manager' (b32387d3-b95a-4e69-93ed-8c2bf52852a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b8b30872-05e7-4838-90f1-0fa5800a1736 tempest-VolumesTransfersV355Test-1203911821 None] Created volume successfully. Jul 06 15:36:52 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" returned: 0 in 0.830s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c90394fe-e195-4116-bb5c-18aae55da970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[838da319-52d5-4f3e-89b7-72525078b66c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:52 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 Jul 06 15:36:52 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:53 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 1073741824" returned: 0 in 0.937s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:53 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 Jul 06 15:36:53 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Acquiring lock "cinder-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:53 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970" returned: 0 in 0.858s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Acquiring lock "cinder-quobyte-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:53 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 Jul 06 15:36:53 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-quobyte-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85bd5c8-9604-457e-8944-2ac8fd3be8f7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:53 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 Jul 06 15:36:53 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:54 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064" returned: 0 in 0.817s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434dece7-ad4b-44be-a948-72687b35d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77022cfd-4cc6-4498-a28a-e991636c83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:54 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Volume volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 (9136e70e-777e-4a57-a1d2-c2dc08d7d064): created successfully Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77022cfd-4cc6-4498-a28a-e991636c83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (a6dc7a29-a24d-49bf-a68d-f2977ee35d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d5d5bbd3-6c36-4c35-acb6-26dd33a688b2 tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:36:54 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0" returned: 0 in 0.911s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:54 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0 Jul 06 15:36:54 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:54 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" returned: 0 in 1.047s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:54 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7 Jul 06 15:36:54 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:55 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0" returned: 0 in 1.042s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-quobyte-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0" released by "delete_volume" :: held 2.019s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:55 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970.7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" returned: 0 in 1.062s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Created reservations ['802eb339-324d-4a65-9ec1-81384b88e530', '0c4f1cd8-c8a2-40d8-b6d2-3a90c66a345d', '08119c0c-520f-4841-bfb1-0226221aafab', '3f154bc2-168a-4705-a875-a641d661dae3'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-7b40ccff-18ee-4d8e-babe-e3d5da4d92a7" released by "_delete_snapshot" :: held 3.920s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-c90394fe-e195-4116-bb5c-18aae55da970" released by "delete_snapshot" :: held 3.952s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:55 devstack cinder-volume[86191]: WARNING cinder.quota [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-190368081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-190368081, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:55 devstack cinder-volume[86191]: WARNING cinder.quota [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-190368081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-190368081, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['cf2b7b52-5c88-4023-a08e-dcb4d155e8b0', '57581d2f-9b61-4a02-bcb7-083b21e5644e', '461734fc-532f-42f6-95b7-fe513b6e3652', 'b3783492-88ff-42fd-8bdc-985992f04bcd'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:55 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:55 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1ddb948b-82a6-4a69-843a-7ad66a0dc28f tempest-GroupSnapshotsTest-1944361660 None] group_snapshot 8d47e998-fdf9-42e7-bd64-84bef0e3d1ab: deleted successfully Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (656d5fd1-a28f-49a1-b7c0-3dac22782fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19679ff6-40ef-4ebf-a170-8182b05f7d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19679ff6-40ef-4ebf-a170-8182b05f7d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-888945727',display_name='tempest-VolumesGetTest-Volume-789249727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c70c4bb-4666-484b-8c12-93c01f0c7ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:56Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3883cfbf-95d1-4970-ace6-1f2e76e04963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3883cfbf-95d1-4970-ace6-1f2e76e04963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34343ef1-4324-46e6-a8d8-3f87ba0b4617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34343ef1-4324-46e6-a8d8-3f87ba0b4617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c70c4bb-4666-484b-8c12-93c01f0c7ec5', 'volume_name': 'volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a454b1-224b-45a0-9d78-62004783b024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a454b1-224b-45a0-9d78-62004783b024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f2a183-526d-42eb-bfb2-347fc33fe34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:56 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Volume 7c70c4bb-4666-484b-8c12-93c01f0c7ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5', 'volume_size': 1} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:36:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-888945727',display_name='tempest-VolumesGetTest-Volume-789249727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c70c4bb-4666-484b-8c12-93c01f0c7ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:36:56Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Creating volume 7c70c4bb-4666-484b-8c12-93c01f0c7ec5 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:36:56 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:56 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 1073741824 Jul 06 15:36:56 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "cinder-quobyte-c90394fe-e195-4116-bb5c-18aae55da970" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-c90394fe-e195-4116-bb5c-18aae55da970" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be63ca0-f54f-4e87-981f-cb92a97daeeb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:56 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.939s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:36:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Deleted volume successfully. Jul 06 15:36:56 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 Jul 06 15:36:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0e00395a-53f0-48f3-8aaf-baa0a7b71e25 tempest-VolumesTransfersV355Test-1183927861 None] Lock "cinder-fc2c1f1e-6398-4cf2-9d58-3140d70e2dc0-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:56 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:57 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 1073741824" returned: 0 in 1.198s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:57 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 Jul 06 15:36:57 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:57 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970" returned: 0 in 1.039s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:57 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970 Jul 06 15:36:57 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:58 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5" returned: 0 in 0.953s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f2a183-526d-42eb-bfb2-347fc33fe34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047259aa-17dd-43d8-bd76-3022a8299aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:36:58 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Volume volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 (7c70c4bb-4666-484b-8c12-93c01f0c7ec5): created successfully Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047259aa-17dd-43d8-bd76-3022a8299aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (656d5fd1-a28f-49a1-b7c0-3dac22782fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:36:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fb8958ac-2407-47c2-86ba-2ecf23f5df22 tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:36:58 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c90394fe-e195-4116-bb5c-18aae55da970" returned: 0 in 1.045s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Lock "cinder-quobyte-c90394fe-e195-4116-bb5c-18aae55da970" released by "delete_volume" :: held 2.195s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:36:58 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['5220cfbb-6390-4422-afe0-82dce7bc9137'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:59 devstack cinder-volume[86191]: WARNING cinder.quota [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-190368081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-190368081, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Created reservations ['c16ba34c-e961-48cb-ae70-911152100ef1', '0abacc2d-87df-4462-9858-62c3597434ce', '4c8ad1d0-fb04-4522-8bcf-25d319bec381', '1f019bd4-10e2-4885-93f8-00f7065602a7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:36:59 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:36:59 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-7c70c4bb-4666-484b-8c12-93c01f0c7ec5-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Lock "cinder-7c70c4bb-4666-484b-8c12-93c01f0c7ec5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-7c70c4bb-4666-484b-8c12-93c01f0c7ec5" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-7c70c4bb-4666-484b-8c12-93c01f0c7ec5" acquired by "delete_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd2817-3e99-4246-be9a-426cdeb9f84f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:36:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:00 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 Jul 06 15:37:00 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:00 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.264s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:00 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-89e61354-b7e4-4805-a57c-c3b1856cfb58 tempest-GroupSnapshotsTest-1944361660 None] Delete group completed successfully. Jul 06 15:37:01 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5" returned: 0 in 1.297s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:01 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5 Jul 06 15:37:01 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:02 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7c70c4bb-4666-484b-8c12-93c01f0c7ec5" returned: 0 in 0.954s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-7c70c4bb-4666-484b-8c12-93c01f0c7ec5" released by "delete_volume" :: held 2.341s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Created reservations ['f513401b-6638-428c-a1fb-e49e4e12c9e9', '9886acd5-f53a-43f5-9570-945e11fa722b', '15a78351-a7b5-46f0-b3a0-279023f8d2a5', '459f7226-8452-47ce-ae29-a8f517e3fbb6'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:02 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:02 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:03 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:03 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-739e9b68-63cc-4c3d-b083-d8d819b9fd16 tempest-VolumesGetTest-704373642 None] Lock "cinder-7c70c4bb-4666-484b-8c12-93c01f0c7ec5-delete_volume" released by "delete_volume" :: held 3.478s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-9136e70e-777e-4a57-a1d2-c2dc08d7d064-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Lock "cinder-9136e70e-777e-4a57-a1d2-c2dc08d7d064-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-9136e70e-777e-4a57-a1d2-c2dc08d7d064" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-9136e70e-777e-4a57-a1d2-c2dc08d7d064" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce313688-e621-4c64-aeb0-fa866b53ef3b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:03 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 Jul 06 15:37:03 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:04 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064" returned: 0 in 1.096s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:04 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064 Jul 06 15:37:04 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:05 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9136e70e-777e-4a57-a1d2-c2dc08d7d064" returned: 0 in 0.755s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-9136e70e-777e-4a57-a1d2-c2dc08d7d064" released by "delete_volume" :: held 1.928s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Created reservations ['929a6964-3d3a-4a28-b91d-7ba5bda44e4a', '64e82fe1-c685-4c4b-9cf3-7ef3a60cafed', 'd2cf2621-c552-4532-b545-105dbfbbbb7e', 'af2fc609-e264-4ba8-979a-e05298981501'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:05 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:05 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Flow 'volume_create_manager' (cdfe10c8-eb43-494e-bf96-6a5ccb51cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1447bfca-d388-4fa6-801c-fd296e2555bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1447bfca-d388-4fa6-801c-fd296e2555bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1163064520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc2da8b-faae-4329-8620-95eabc6fb9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38bfbde3f21344228ec80fbfa6432cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:06Z,use_quota=True,user_id='19e0a8ac7e8a46de96b9634e251b48ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826a4842-2dbf-47ea-bd0f-9765f6bcc427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826a4842-2dbf-47ea-bd0f-9765f6bcc427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2d4b85-3cc2-4b38-af08-b0bcbbe40006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2d4b85-3cc2-4b38-af08-b0bcbbe40006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc2da8b-faae-4329-8620-95eabc6fb9ad', 'volume_name': 'volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bdedc8-6e2c-4001-920a-5e216e86f1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bdedc8-6e2c-4001-920a-5e216e86f1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1292d05b-b431-4647-8877-69188199eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:05 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad', 'volume_size': 1} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1163064520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc2da8b-faae-4329-8620-95eabc6fb9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38bfbde3f21344228ec80fbfa6432cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:06Z,use_quota=True,user_id='19e0a8ac7e8a46de96b9634e251b48ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Creating volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:05 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:05 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad 1073741824 Jul 06 15:37:05 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (54341638-4715-4ced-9733-7521221ef39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13da262-5067-4029-b30a-8dbe601fd37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13da262-5067-4029-b30a-8dbe601fd37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-895247456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a37e6ba-778f-498b-9804-a858a7604db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:06Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a503334-2084-40ee-b62a-8a7ab96027a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a503334-2084-40ee-b62a-8a7ab96027a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ef00d0-9c46-4b32-be8d-876f7cdea718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ef00d0-9c46-4b32-be8d-876f7cdea718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a37e6ba-778f-498b-9804-a858a7604db5', 'volume_name': 'volume-4a37e6ba-778f-498b-9804-a858a7604db5', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806d5c6e-13e2-41d0-9f15-d72cc83fd947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806d5c6e-13e2-41d0-9f15-d72cc83fd947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c420798d-7fd4-4f94-b43c-f233152e9b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Volume 4a37e6ba-778f-498b-9804-a858a7604db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a37e6ba-778f-498b-9804-a858a7604db5', 'volume_size': 1} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:06 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.859s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dedc1fc0-1392-40ab-855e-f5b9b81da638 tempest-VolumesGetTest-704373642 None] Lock "cinder-9136e70e-777e-4a57-a1d2-c2dc08d7d064-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:06 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad 1073741824" returned: 0 in 0.983s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:06 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad Jul 06 15:37:06 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:37:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:37:07 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad" returned: 0 in 0.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-895247456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a37e6ba-778f-498b-9804-a858a7604db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:06Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Creating volume 4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:07 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1292d05b-b431-4647-8877-69188199eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:07 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 1073741824 Jul 06 15:37:07 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac39c38b-fc3f-4ad6-95c0-eed20b76288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:07 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Volume volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad (6dc2da8b-faae-4329-8620-95eabc6fb9ad): created successfully Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac39c38b-fc3f-4ad6-95c0-eed20b76288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Flow 'volume_create_manager' (cdfe10c8-eb43-494e-bf96-6a5ccb51cc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6dd50eff-60cd-451a-9e97-28d75a78402b tempest-VolumesSnapshotListTestJSON-219248648 None] Created volume successfully. Jul 06 15:37:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:08 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 1073741824" returned: 0 in 0.980s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:08 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:08 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:09 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.766s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.302s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Creating offline snapshot 7d8260b0-2077-443e-b57b-a5de30a89f69 of volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c420798d-7fd4-4f94-b43c-f233152e9b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a37e6ba-778f-498b-9804-a858a7604db5', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6763c8-81c5-4d5e-8f7d-7bff64229565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebd87c1-38a2-4b6e-9e49-b164146fedb3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:09 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Volume volume-4a37e6ba-778f-498b-9804-a858a7604db5 (4a37e6ba-778f-498b-9804-a858a7604db5): created successfully Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6763c8-81c5-4d5e-8f7d-7bff64229565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (54341638-4715-4ced-9733-7521221ef39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5fa4cf3f-44e2-4311-bd5d-30f4fea8b90c tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:37:09 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad Jul 06 15:37:09 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:10 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad" returned: 0 in 0.839s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:10 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 1G Jul 06 15:37:10 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=99,cinder:UPDATE=152,cinder:INSERT=31,cinder:DELETE=9 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=111,cinder:UPDATE=110,cinder:INSERT=31,cinder:DELETE=6 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:11 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 1G" returned: 0 in 1.039s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:11 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:11 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (42e1cc61-31d5-49cf-a0dc-532833a83642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0a5771-243d-4a0a-8692-a7238b0eefee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0a5771-243d-4a0a-8692-a7238b0eefee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1719247394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94df2deb-d18e-4032-b6ab-389059535001,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4a37e6ba-778f-498b-9804-a858a7604db5,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:11Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550b475a-b8ec-4322-a788-c27e308ddaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550b475a-b8ec-4322-a788-c27e308ddaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acaf760-aa6a-4790-9661-38abe58727db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8acaf760-aa6a-4790-9661-38abe58727db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '94df2deb-d18e-4032-b6ab-389059535001', 'volume_name': 'volume-94df2deb-d18e-4032-b6ab-389059535001', 'volume_size': 1, 'source_volid': '4a37e6ba-778f-498b-9804-a858a7604db5', 'source_volstatus': 'available'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a966e4-cf9f-429a-8232-166834bac8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a966e4-cf9f-429a-8232-166834bac8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ee2785-0c44-4f62-9ae3-2b0f9e8b7d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:11 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Volume 94df2deb-d18e-4032-b6ab-389059535001: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-94df2deb-d18e-4032-b6ab-389059535001', 'volume_size': 1, 'source_volid': '4a37e6ba-778f-498b-9804-a858a7604db5', 'source_volstatus': 'available'} Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:11 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 0.761s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:11 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 is being set with open permissions: ugo+rw Jul 06 15:37:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:11 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:11 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:12 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 0.689s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:12 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info Jul 06 15:37:12 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d2f4e8dc-886a-4760-bd78-6facc41328bf tempest-GroupsV320Test-187286695 None] Group tempest-GroupsV320Test-Group-252867706: creating Jul 06 15:37:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d2f4e8dc-886a-4760-bd78-6facc41328bf tempest-GroupsV320Test-187286695 None] Group tempest-GroupsV320Test-Group-252867706: created successfully Jul 06 15:37:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d2f4e8dc-886a-4760-bd78-6facc41328bf tempest-GroupsV320Test-187286695 None] Create group completed successfully. Jul 06 15:37:13 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info" returned: 0 in 0.678s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:13 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info is being set with open permissions: ugo+rw Jul 06 15:37:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:13 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info Jul 06 15:37:13 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:14 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.info" returned: 0 in 0.651s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.773s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.693s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:14 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Cloning volume 4a37e6ba-778f-498b-9804-a858a7604db5 to volume 94df2deb-d18e-4032-b6ab-389059535001 Jul 06 15:37:14 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-36898c3a-fc59-486c-ba9f-3770475fdad6 tempest-VolumesSnapshotListTestJSON-219248648 None] Create snapshot completed successfully Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Creating offline snapshot e2800b7d-d393-47c9-90e7-bbdd74ae4a48 of volume 4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c38fbd-26b0-40ec-84fc-3102ebee0825]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:14 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:14 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Created reservations ['4abb6290-7075-43d1-99eb-fd7aab8a8060'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:14 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:14 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:15 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.896s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:15 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 1G Jul 06 15:37:15 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:15 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d3028bd6-2eae-4bf9-bb38-4eb5cc348237 tempest-GroupsV320Test-187286695 None] Delete group completed successfully. Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Acquiring lock "cinder-067395f5-9191-4391-8140-a53428780bfd-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Lock "cinder-067395f5-9191-4391-8140-a53428780bfd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Acquiring lock "cinder-quobyte-067395f5-9191-4391-8140-a53428780bfd" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Lock "cinder-quobyte-067395f5-9191-4391-8140-a53428780bfd" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[251fe067-65fa-4771-afee-9f1c514c3473]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:15 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 1G" returned: 0 in 0.881s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a37e6ba-778f-498b-9804-a858a7604db5 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:15 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a37e6ba-778f-498b-9804-a858a7604db5 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 Jul 06 15:37:15 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd Jul 06 15:37:16 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a37e6ba-778f-498b-9804-a858a7604db5 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48" returned: 0 in 0.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:16 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 is being set with open permissions: ugo+rw Jul 06 15:37:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:16 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 Jul 06 15:37:16 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:16 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:16 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd Jul 06 15:37:16 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:17 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48" returned: 0 in 0.727s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:17 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info Jul 06 15:37:17 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:17 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-067395f5-9191-4391-8140-a53428780bfd" returned: 0 in 0.723s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Lock "cinder-quobyte-067395f5-9191-4391-8140-a53428780bfd" released by "delete_volume" :: held 1.623s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Created reservations ['b7b7b854-9cb0-4156-ab6e-2ed8d117b33a', '46a16213-6927-4787-a1e6-2b109cd7feb0', 'fdb6b7d1-f998-4d08-8093-11ee94a7226e', '092b778d-ec14-4d43-b28d-e12f9cf3b876'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:17 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:17 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:18 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info" returned: 0 in 0.844s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:18 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info is being set with open permissions: ugo+rw Jul 06 15:37:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:18 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info Jul 06 15:37:18 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:18 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:18 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:18 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Deleted volume successfully. Jul 06 15:37:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-87365638-6017-442b-b966-273e7c725a19 tempest-VolumesNegativeTest-1017420926 None] Lock "cinder-067395f5-9191-4391-8140-a53428780bfd-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:19 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.info" returned: 0 in 0.784s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-94df2deb-d18e-4032-b6ab-389059535001" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-94df2deb-d18e-4032-b6ab-389059535001" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] snapshot: e2800b7d-d393-47c9-90e7-bbdd74ae4a48, volume: 94df2deb-d18e-4032-b6ab-389059535001, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead16fb8-9d0e-4685-be2e-74d15cbf17e2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:19 devstack sudo[97770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 Jul 06 15:37:19 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:19 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48" returned: 0 in 0.833s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a37e6ba-778f-498b-9804-a858a7604db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce28685-555c-4aa1-ae1e-85de0f6da5f7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:20 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:20 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:20 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.779s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:20 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:37:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:20 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 Jul 06 15:37:20 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Flow 'volume_create_manager' (8c2a5d67-dd78-4a16-8d35-8af15e7add55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce9d45f-719c-45ee-aec9-1cb576378145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce9d45f-719c-45ee-aec9-1cb576378145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1575921597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00058be1-fcea-4548-8e21-7e74712811af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add3060a2fed46d58b5a3f6a73972dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:22Z,use_quota=True,user_id='ff689301835e4ca3adfc86e150d33601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812aceed-9930-4f4f-b4d2-01cfef0347a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812aceed-9930-4f4f-b4d2-01cfef0347a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb625b8b-d7f8-4c39-adc7-013769082b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb625b8b-d7f8-4c39-adc7-013769082b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00058be1-fcea-4548-8e21-7e74712811af', 'volume_name': 'volume-00058be1-fcea-4548-8e21-7e74712811af', 'volume_size': 2}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9093e9ab-862d-4822-8593-4710c2d2df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9093e9ab-862d-4822-8593-4710c2d2df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ead0faf-cb7d-419c-95d6-d4647993ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:21 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Volume 00058be1-fcea-4548-8e21-7e74712811af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00058be1-fcea-4548-8e21-7e74712811af', 'volume_size': 2} Jul 06 15:37:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:25 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001" returned: 0 in 5.076s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b5bf8-6011-42d8-b880-cf3931b5ed21]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:25 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:25 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:26 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.919s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:26 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:37:26 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Converted 1024.00 MB image at 201.69 MB/s Jul 06 15:37:26 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 is being set with open permissions: ugo+rw Jul 06 15:37:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:26 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 Jul 06 15:37:26 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:27 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001" returned: 0 in 0.687s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-94df2deb-d18e-4032-b6ab-389059535001" released by "_copy_volume_from_snapshot" :: held 8.421s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-e2800b7d-d393-47c9-90e7-bbdd74ae4a48" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-e2800b7d-d393-47c9-90e7-bbdd74ae4a48" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Deleting offline snapshot e2800b7d-d393-47c9-90e7-bbdd74ae4a48 of volume 4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] snapshot_file for this snap is: volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a714f1-e102-4020-a03b-e5f2c9710eac]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:27 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 Jul 06 15:37:27 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:28 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a37e6ba-778f-498b-9804-a858a7604db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:28 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c942d3-b992-4e80-ae32-49f67c3be13b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:28 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:28 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:29 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.791s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:29 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 Jul 06 15:37:29 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:29 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:29 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48 Jul 06 15:37:30 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:30 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5.e2800b7d-d393-47c9-90e7-bbdd74ae4a48" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-e2800b7d-d393-47c9-90e7-bbdd74ae4a48" released by "_delete_snapshot" :: held 3.160s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.677s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.129s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Creating offline snapshot 3da49277-fcca-4b3a-9eeb-2d0aad337ac2 of volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ee2785-0c44-4f62-9ae3-2b0f9e8b7d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94df2deb-d18e-4032-b6ab-389059535001', 'volume_size': 1, 'source_volid': '4a37e6ba-778f-498b-9804-a858a7604db5', 'source_volstatus': 'available'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b6b3cc-bd22-48c8-ba3a-249180388c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9579d68b-0598-4bbf-a52b-a1c61b2eb017]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Volume volume-94df2deb-d18e-4032-b6ab-389059535001 (94df2deb-d18e-4032-b6ab-389059535001): created successfully Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b6b3cc-bd22-48c8-ba3a-249180388c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (42e1cc61-31d5-49cf-a0dc-532833a83642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-de4d98e5-4366-4628-967e-63d530e70c9e tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:37:30 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:30 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:31 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 0.943s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:31 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 1G Jul 06 15:37:31 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (48531221-1843-4e1d-a1a0-9b718baf89f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bde63a-2709-4714-8954-c48cecb08d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bde63a-2709-4714-8954-c48cecb08d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1072905186',display_name='tempest-VolumesGetTest-Volume-2116395175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ec14b1-5e49-4415-b03f-8d99cbe971f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:32Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9505dd39-dd7a-4984-bfbf-b1db47c94186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9505dd39-dd7a-4984-bfbf-b1db47c94186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504252d8-cb3f-420c-b7bd-c79c461046fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504252d8-cb3f-420c-b7bd-c79c461046fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ec14b1-5e49-4415-b03f-8d99cbe971f6', 'volume_name': 'volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82899f95-9067-4cf8-a729-96df32db44da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82899f95-9067-4cf8-a729-96df32db44da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e508688-dd6d-42d5-9e58-82eddfd750e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Volume 75ec14b1-5e49-4415-b03f-8d99cbe971f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6', 'volume_size': 1} Jul 06 15:37:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:32 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 1G" returned: 0 in 0.908s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:32 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:32 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:33 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.724s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:33 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 is being set with open permissions: ugo+rw Jul 06 15:37:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:33 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:33 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:34 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.677s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.356s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.366s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1575921597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00058be1-fcea-4548-8e21-7e74712811af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='add3060a2fed46d58b5a3f6a73972dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:22Z,use_quota=True,user_id='ff689301835e4ca3adfc86e150d33601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Creating volume 00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:34 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af 2147483648 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:34 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af 2147483648 Jul 06 15:37:34 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ac5b5795-2fe2-4b12-b937-923fa53f9355 tempest-VolumesSnapshotListTestJSON-219248648 None] Create snapshot completed successfully Jul 06 15:37:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:35 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af 2147483648" returned: 0 in 0.949s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:35 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af Jul 06 15:37:35 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:35 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af" returned: 0 in 0.663s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.851s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1072905186',display_name='tempest-VolumesGetTest-Volume-2116395175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ec14b1-5e49-4415-b03f-8d99cbe971f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:32Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Creating volume 75ec14b1-5e49-4415-b03f-8d99cbe971f6 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:35 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ead0faf-cb7d-419c-95d6-d4647993ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00058be1-fcea-4548-8e21-7e74712811af', 'volume_size': 2}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06d280d-a613-4177-a9eb-d64b7b6ac8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:35 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 1073741824 Jul 06 15:37:35 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:35 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Volume volume-00058be1-fcea-4548-8e21-7e74712811af (00058be1-fcea-4548-8e21-7e74712811af): created successfully Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06d280d-a613-4177-a9eb-d64b7b6ac8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Flow 'volume_create_manager' (8c2a5d67-dd78-4a16-8d35-8af15e7add55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-46612d92-5581-44c6-b4ec-3e8ee1356fa3 tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Created volume successfully. Jul 06 15:37:36 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 1073741824" returned: 0 in 0.977s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:36 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 Jul 06 15:37:36 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:37 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6" returned: 0 in 0.698s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.798s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e508688-dd6d-42d5-9e58-82eddfd750e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7ca651-a92b-43c2-a26d-276d3bc9ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Creating offline snapshot 4677bf15-cdcc-40ae-89c3-bf8bc2b79537 of volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:37 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Volume volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 (75ec14b1-5e49-4415-b03f-8d99cbe971f6): created successfully Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef7ca651-a92b-43c2-a26d-276d3bc9ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (48531221-1843-4e1d-a1a0-9b718baf89f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f11f2e-89ef-4cfc-8dac-bfff1de638c2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f98fa9ad-7232-430d-a53b-d7b72f640e7d tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:37:37 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:37 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-75ec14b1-5e49-4415-b03f-8d99cbe971f6-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Lock "cinder-75ec14b1-5e49-4415-b03f-8d99cbe971f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-75ec14b1-5e49-4415-b03f-8d99cbe971f6" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-75ec14b1-5e49-4415-b03f-8d99cbe971f6" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[630727bb-a571-493e-b07f-d2160d385bba]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:38 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.875s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:38 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 1G Jul 06 15:37:38 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:38 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 Jul 06 15:37:38 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:39 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6" returned: 0 in 0.813s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:39 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6 Jul 06 15:37:39 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:39 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 1G" returned: 0 in 0.963s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:39 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 Jul 06 15:37:39 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:39 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-75ec14b1-5e49-4415-b03f-8d99cbe971f6" returned: 0 in 0.716s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-75ec14b1-5e49-4415-b03f-8d99cbe971f6" released by "delete_volume" :: held 1.576s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Created reservations ['f3d7a801-2079-4f30-aea1-16bb24c76c13', '72b9e2ce-764c-41c4-b95a-b7df9f4c1d56', '46147e60-9fee-4fb7-99a9-1b654285604c', '9ffaa2e3-ad9b-4919-b7b1-a338f6d50404'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:40 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:40 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:40 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537" returned: 0 in 0.775s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:40 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 is being set with open permissions: ugo+rw Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:40 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 Jul 06 15:37:40 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Flow 'volume_create_manager' (aa2404df-f544-495d-ac4c-98c1c7aeead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b663d77d-db42-42cf-af4a-0e5aa35978e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b663d77d-db42-42cf-af4a-0e5aa35978e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659418611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a1601-27b7-4623-80af-7fe73c00ab0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d627ff8cc747d5a8d6f6a14d08d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:40Z,use_quota=True,user_id='c59e6f3418b649d6b21ea515b95eb731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505b9fee-d725-423b-a41f-860893d2416b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (505b9fee-d725-423b-a41f-860893d2416b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d125ae-65d8-468e-a8a9-3959070de64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d125ae-65d8-468e-a8a9-3959070de64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274a1601-27b7-4623-80af-7fe73c00ab0d', 'volume_name': 'volume-274a1601-27b7-4623-80af-7fe73c00ab0d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d97139-40c0-4f22-b84d-4e1a39b3f4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56d97139-40c0-4f22-b84d-4e1a39b3f4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a656809-9945-4e3f-a62e-b869f864bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Volume 274a1601-27b7-4623-80af-7fe73c00ab0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274a1601-27b7-4623-80af-7fe73c00ab0d', 'volume_size': 1} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-94df2deb-d18e-4032-b6ab-389059535001-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Lock "cinder-94df2deb-d18e-4032-b6ab-389059535001-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-94df2deb-d18e-4032-b6ab-389059535001" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-94df2deb-d18e-4032-b6ab-389059535001" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1fbbec-5dfb-448f-9fbd-455346730ebb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:40 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 Jul 06 15:37:40 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:40 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.698s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f2169266-e40e-486a-84ee-648cd8d80194 tempest-VolumesGetTest-704373642 None] Lock "cinder-75ec14b1-5e49-4415-b03f-8d99cbe971f6-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:40 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537" returned: 0 in 0.698s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.441s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.793s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Creating offline snapshot 419e8d8e-cc63-42c5-938c-79c2326bd492 of volume 00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:37:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f3ff78d8-a355-4bfb-a12a-0f9c144b6780 tempest-VolumesSnapshotListTestJSON-219248648 None] Create snapshot completed successfully Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbbd823-24ab-48f7-96d4-559eea10d5f3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:41 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af Jul 06 15:37:41 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:41 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001" returned: 0 in 0.770s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:41 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001 Jul 06 15:37:41 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:41 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af" returned: 0 in 0.811s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 2G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:41 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 2G Jul 06 15:37:41 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:42 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-94df2deb-d18e-4032-b6ab-389059535001" returned: 0 in 0.709s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-94df2deb-d18e-4032-b6ab-389059535001" released by "delete_volume" :: held 1.531s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Created reservations ['13a84570-e112-49d2-8a17-b5d0081fe3c5', 'b9eb04c1-2013-4b4b-89a9-448b06d237fa', 'a3201c31-029e-40aa-a350-d6d5f921e5cd', 'adc0f758-a86a-4e9a-83ca-190293b367d5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:42 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:42 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:42 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 2G" returned: 0 in 0.871s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00058be1-fcea-4548-8e21-7e74712811af -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:42 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00058be1-fcea-4548-8e21-7e74712811af -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 Jul 06 15:37:42 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-4a37e6ba-778f-498b-9804-a858a7604db5-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Lock "cinder-4a37e6ba-778f-498b-9804-a858a7604db5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-4a37e6ba-778f-498b-9804-a858a7604db5" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-4a37e6ba-778f-498b-9804-a858a7604db5" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[83728a09-a295-4045-809a-4e3d6c9e47c5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-4677bf15-cdcc-40ae-89c3-bf8bc2b79537-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-4677bf15-cdcc-40ae-89c3-bf8bc2b79537-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-4677bf15-cdcc-40ae-89c3-bf8bc2b79537" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-4677bf15-cdcc-40ae-89c3-bf8bc2b79537" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Deleting offline snapshot 4677bf15-cdcc-40ae-89c3-bf8bc2b79537 of volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:43 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] snapshot_file for this snap is: volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb04e7-906b-4038-86ba-13f0783a9b02]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3388c67d-b7a8-4f5b-888f-07b04c66a1ab tempest-VolumesGetTest-704373642 None] Lock "cinder-94df2deb-d18e-4032-b6ab-389059535001-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:43 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:43 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:43 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 Jul 06 15:37:43 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:43 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00058be1-fcea-4548-8e21-7e74712811af -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492" returned: 0 in 0.896s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:43 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 is being set with open permissions: ugo+rw Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:43 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 Jul 06 15:37:43 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:43 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.873s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:43 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5 Jul 06 15:37:43 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:44 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537" returned: 0 in 0.799s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e54fe-0635-45d4-8770-8b02da65133f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:44 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:44 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:44 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492" returned: 0 in 0.676s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:44 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info Jul 06 15:37:44 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:44 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4a37e6ba-778f-498b-9804-a858a7604db5" returned: 0 in 0.720s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-4a37e6ba-778f-498b-9804-a858a7604db5" released by "delete_volume" :: held 1.677s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Created reservations ['363a148a-9534-4ef3-86cd-64bad061b459', '682fd3fd-6106-40b4-b36c-9ba181f0d431', 'f987d2a6-ee9c-49ae-9a8d-22081b7f3ec6', '367e5867-25e1-45e1-9fe2-6d327e94cd1e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:44 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:44 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:44 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.848s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:44 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 Jul 06 15:37:44 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:44 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info" returned: 0 in 0.704s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:44 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info is being set with open permissions: ugo+rw Jul 06 15:37:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:44 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info Jul 06 15:37:44 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:45 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.739s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-80c17c25-7cef-4117-b551-a9913af38ba4 tempest-VolumesGetTest-704373642 None] Lock "cinder-4a37e6ba-778f-498b-9804-a858a7604db5-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:45 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.info" returned: 0 in 0.768s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.826s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.438s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1659418611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274a1601-27b7-4623-80af-7fe73c00ab0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d627ff8cc747d5a8d6f6a14d08d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:40Z,use_quota=True,user_id='c59e6f3418b649d6b21ea515b95eb731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Creating volume 274a1601-27b7-4623-80af-7fe73c00ab0d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:45 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:45 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d 1073741824 Jul 06 15:37:45 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c0b07043-9f8e-44dc-8427-ca62e68a607c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Create snapshot completed successfully Jul 06 15:37:45 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537" returned: 0 in 0.991s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:45 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537 Jul 06 15:37:45 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (9fc14f2b-fcd4-4ff6-b819-4b6282c90859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd591e4-ae75-4154-ad94-b94935f0d4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd591e4-ae75-4154-ad94-b94935f0d4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1424497686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3396aa-502f-420b-a34e-c51f0c47067c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:46Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72066424-9be4-473a-b995-72143cb3eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72066424-9be4-473a-b995-72143cb3eb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a5f78e-03ab-46c4-86ff-8126be0c7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1a5f78e-03ab-46c4-86ff-8126be0c7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b3396aa-502f-420b-a34e-c51f0c47067c', 'volume_name': 'volume-0b3396aa-502f-420b-a34e-c51f0c47067c', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f30169d-7389-4614-8ded-dcb5ffac74c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f30169d-7389-4614-8ded-dcb5ffac74c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42eef097-18ed-4692-b97e-4fffa59c6061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:46 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Volume 0b3396aa-502f-420b-a34e-c51f0c47067c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b3396aa-502f-420b-a34e-c51f0c47067c', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Trying to clone 0b3396aa-502f-420b-a34e-c51f0c47067c from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:37:46 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.4677bf15-cdcc-40ae-89c3-bf8bc2b79537" returned: 0 in 0.699s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-4677bf15-cdcc-40ae-89c3-bf8bc2b79537" released by "_delete_snapshot" :: held 3.467s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" released by "delete_snapshot" :: held 3.517s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:46 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "cinder-419e8d8e-cc63-42c5-938c-79c2326bd492-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d 1073741824" returned: 0 in 1.098s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-419e8d8e-cc63-42c5-938c-79c2326bd492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "cinder-quobyte-00058be1-fcea-4548-8e21-7e74712811af" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Created reservations ['19b9a49f-2f6a-4f7d-bea4-f3495d96e408', 'c946a513-132a-4cf8-a0ff-430ae6b2794c', '898f78e0-b0e2-45fb-8e53-7ac9d454c05b', 'eb3928b6-756e-411c-a19e-87bdf3e4a8c5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-quobyte-00058be1-fcea-4548-8e21-7e74712811af" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "cinder-quobyte-419e8d8e-cc63-42c5-938c-79c2326bd492" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-quobyte-419e8d8e-cc63-42c5-938c-79c2326bd492" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Deleting offline snapshot 419e8d8e-cc63-42c5-938c-79c2326bd492 of volume 00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:46 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d Jul 06 15:37:46 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] snapshot_file for this snap is: volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:37:47 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f413d2f-e395-4c23-a48a-d79746c11775]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb38b4a-1dc2-4ae0-a945-a98b1a91d946]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Delete snapshot completed successfully. Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-78defbd0-d1bf-4b9f-9987-e5d2b5b3e12f tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-4677bf15-cdcc-40ae-89c3-bf8bc2b79537-delete_snapshot" released by "delete_snapshot" :: held 3.972s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:47 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 Jul 06 15:37:47 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:47 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD Jul 06 15:37:47 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-3da49277-fcca-4b3a-9eeb-2d0aad337ac2-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-3da49277-fcca-4b3a-9eeb-2d0aad337ac2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-3da49277-fcca-4b3a-9eeb-2d0aad337ac2" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-3da49277-fcca-4b3a-9eeb-2d0aad337ac2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Deleting offline snapshot 3da49277-fcca-4b3a-9eeb-2d0aad337ac2 of volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] snapshot_file for this snap is: volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[01489fd7-4221-47f0-859c-1cdc3764ef62]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:47 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:47 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:47 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d" returned: 0 in 0.717s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a656809-9945-4e3f-a62e-b869f864bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274a1601-27b7-4623-80af-7fe73c00ab0d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eaa2d1-06c1-45de-b526-dca3353e16a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Volume volume-274a1601-27b7-4623-80af-7fe73c00ab0d (274a1601-27b7-4623-80af-7fe73c00ab0d): created successfully Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5eaa2d1-06c1-45de-b526-dca3353e16a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Flow 'volume_create_manager' (aa2404df-f544-495d-ac4c-98c1c7aeead0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-49b136fa-b01c-4340-b121-ed04dd6b1680 tempest-VolumesListAdminTestJSON-1513184701 None] Created volume successfully. Jul 06 15:37:47 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 is fetched for user eefcc5c6bdcf4629b63b4b1b8438fad3. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:37:47 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492" returned: 0 in 0.893s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00058be1-fcea-4548-8e21-7e74712811af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa87591-4448-464f-822f-113caa039ccb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44a284-07dd-4535-9e13-d6fc4bf6b36b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:48 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af Jul 06 15:37:48 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:48 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD Jul 06 15:37:48 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:48 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.844s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362e798-4ee2-47f4-b23b-581fe0678ba8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:48 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:48 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:48 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1424497686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3396aa-502f-420b-a34e-c51f0c47067c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:46Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Creating volume 0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:48 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:48 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af" returned: 0 in 0.798s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:48 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c 1073741824 Jul 06 15:37:48 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:48 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 Jul 06 15:37:48 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:49 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 0.874s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:49 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:49 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Flow 'volume_create_manager' (b5f2cf28-ce54-4ff7-ad1c-5f91cb5d2871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d463aa2-7574-4819-9832-858bd62b6b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d463aa2-7574-4819-9832-858bd62b6b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1310433555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603a070c-0a15-42f7-b9a9-29a71dd11fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d627ff8cc747d5a8d6f6a14d08d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:49Z,use_quota=True,user_id='c59e6f3418b649d6b21ea515b95eb731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe7ea79-2c76-4cff-93d9-b18969743071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe7ea79-2c76-4cff-93d9-b18969743071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8064571-42b8-4c26-9096-8f61ea3f8bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8064571-42b8-4c26-9096-8f61ea3f8bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '603a070c-0a15-42f7-b9a9-29a71dd11fe4', 'volume_name': 'volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f6cd4-7a77-4e39-8ad3-09a5f4044a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930f6cd4-7a77-4e39-8ad3-09a5f4044a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64eba5c0-f4a6-4e2c-acc3-80be74c72f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Volume 603a070c-0a15-42f7-b9a9-29a71dd11fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4', 'volume_size': 1} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:49 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c 1073741824" returned: 0 in 0.914s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:49 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492" returned: 0 in 0.925s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:49 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492 Jul 06 15:37:49 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:49 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:37:49 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:50 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.908s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:50 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2 Jul 06 15:37:50 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:50 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af.419e8d8e-cc63-42c5-938c-79c2326bd492" returned: 0 in 0.693s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:50 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 0 in 0.714s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.830s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1310433555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603a070c-0a15-42f7-b9a9-29a71dd11fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d627ff8cc747d5a8d6f6a14d08d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:49Z,use_quota=True,user_id='c59e6f3418b649d6b21ea515b95eb731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Creating volume 603a070c-0a15-42f7-b9a9-29a71dd11fe4 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:50 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-quobyte-419e8d8e-cc63-42c5-938c-79c2326bd492" released by "_delete_snapshot" :: held 3.469s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:50 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 1073741824 Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-quobyte-00058be1-fcea-4548-8e21-7e74712811af" released by "delete_snapshot" :: held 3.523s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:50 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Attempting download of 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume 0b3396aa-502f-420b-a34e-c51f0c47067c. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Created reservations ['d3fb7758-2f65-458f-a61e-56d832f789ae', 'f09558d0-2fbc-40c4-b7ad-ea5ecdab96f9', '514c264c-568c-46d7-845b-386ef56eb268', '3250eade-c1db-4f21-a471-4b99c2232a55'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f387f5c3-e63e-4acd-9a17-9d9c017ff316]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Delete snapshot completed successfully. Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04788805-466c-4f64-bd71-5bdf34b6b57c tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-419e8d8e-cc63-42c5-938c-79c2326bd492-delete_snapshot" released by "delete_snapshot" :: held 3.767s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:50 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q Jul 06 15:37:50 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:50 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.3da49277-fcca-4b3a-9eeb-2d0aad337ac2" returned: 0 in 0.698s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-3da49277-fcca-4b3a-9eeb-2d0aad337ac2" released by "_delete_snapshot" :: held 3.430s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" released by "delete_snapshot" :: held 3.460s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Created reservations ['80bf4c6e-5146-4c3c-8a2e-c4d77042d1da', '76b29b46-13b9-4ebf-8528-a4593f142389', '4177baa7-d5d0-4dc8-9f38-cc6991bdd494', '8b6310fb-82a3-4121-b427-d3fcabd3531b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Delete snapshot completed successfully. Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4568acce-4efd-400a-a5cf-ea2eb715dc7a tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-3da49277-fcca-4b3a-9eeb-2d0aad337ac2-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "cinder-00058be1-fcea-4548-8e21-7e74712811af-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-00058be1-fcea-4548-8e21-7e74712811af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "cinder-quobyte-00058be1-fcea-4548-8e21-7e74712811af" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-quobyte-00058be1-fcea-4548-8e21-7e74712811af" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed30706-e54a-4ca4-b6a1-7ffd5ec1bf12]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:51 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:51 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 1073741824" returned: 0 in 0.936s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:51 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af Jul 06 15:37:51 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:51 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 Jul 06 15:37:51 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:51 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q Jul 06 15:37:51 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-7d8260b0-2077-443e-b57b-a5de30a89f69-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-7d8260b0-2077-443e-b57b-a5de30a89f69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-7d8260b0-2077-443e-b57b-a5de30a89f69" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-7d8260b0-2077-443e-b57b-a5de30a89f69" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Deleting offline snapshot 7d8260b0-2077-443e-b57b-a5de30a89f69 of volume 6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] snapshot_file for this snap is: volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591340c-1612-4891-9558-0506e9bd8348]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:51 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:51 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:52 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q" returned: 1 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_q4d81g1q' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e89a08-4bb8-4cdf-bb6f-b65f17dc1cb7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:52 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af" returned: 0 in 0.860s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4" returned: 0 in 0.761s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:52 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af Jul 06 15:37:52 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64eba5c0-f4a6-4e2c-acc3-80be74c72f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eeb14ee-4146-45a7-a3ec-e1d809ee06d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Volume volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 (603a070c-0a15-42f7-b9a9-29a71dd11fe4): created successfully Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eeb14ee-4146-45a7-a3ec-e1d809ee06d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Flow 'volume_create_manager' (b5f2cf28-ce54-4ff7-ad1c-5f91cb5d2871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4ab7b27e-8254-42c3-af50-26e5a9c30f4f tempest-VolumesListAdminTestJSON-1513184701 None] Created volume successfully. Jul 06 15:37:52 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD Jul 06 15:37:52 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:52 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 0.879s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a60c929-04b2-445e-8c4f-086ccaaa9107]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:52 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad Jul 06 15:37:52 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:52 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-00058be1-fcea-4548-8e21-7e74712811af" returned: 0 in 0.723s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-quobyte-00058be1-fcea-4548-8e21-7e74712811af" released by "delete_volume" :: held 1.658s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Created reservations ['7a528d93-2e3a-43f1-8d37-fbd4c9f2d7ec', '05b53702-cf7a-45ab-827d-9886eab8e5ee', '460b9935-6563-4ffc-8e24-1a9fcfc71d3f', 'b5b41e05-e7c8-49aa-b7f5-a22219bbcd43'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:53 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD" returned: 0 in 0.887s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] 9a5687fe-7bc5-4daa-b5b4-270d79910583 was qcow2, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:37:53 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:53 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Flow 'volume_create_manager' (efbb9128-064b-4fe5-866c-41f45b4d3abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af794ae4-e5a4-4725-b636-2a846a048d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af794ae4-e5a4-4725-b636-2a846a048d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1510225716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d873d8-2265-47d0-864f-58627aedaaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d627ff8cc747d5a8d6f6a14d08d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:53Z,use_quota=True,user_id='c59e6f3418b649d6b21ea515b95eb731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41839bfa-f02f-4b74-af5f-a712b692806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41839bfa-f02f-4b74-af5f-a712b692806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8120f9e1-011a-48d5-802b-fc810127601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8120f9e1-011a-48d5-802b-fc810127601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d873d8-2265-47d0-864f-58627aedaaff', 'volume_name': 'volume-90d873d8-2265-47d0-864f-58627aedaaff', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a12d01f-3b81-4995-aa67-29753c598384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a12d01f-3b81-4995-aa67-29753c598384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be4872-f755-4b70-9fa1-1ef51fd499b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:53 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Volume 90d873d8-2265-47d0-864f-58627aedaaff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d873d8-2265-47d0-864f-58627aedaaff', 'volume_size': 1} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1510225716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d873d8-2265-47d0-864f-58627aedaaff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d627ff8cc747d5a8d6f6a14d08d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:53Z,use_quota=True,user_id='c59e6f3418b649d6b21ea515b95eb731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Creating volume 90d873d8-2265-47d0-864f-58627aedaaff {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:53 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff 1073741824 Jul 06 15:37:53 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:53 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad" returned: 0 in 1.017s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:53 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:53 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:54 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.931s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Deleted volume successfully. Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c801482c-1813-45d4-a0e5-3e94ea328b5a tempest-VolumesSnapshotNegativeTestJSON-1528588103 None] Lock "cinder-00058be1-fcea-4548-8e21-7e74712811af-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:54 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff 1073741824" returned: 0 in 1.301s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:54 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff Jul 06 15:37:54 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:54 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 1.051s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:54 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69 Jul 06 15:37:54 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:55 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff" returned: 0 in 0.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97be4872-f755-4b70-9fa1-1ef51fd499b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d873d8-2265-47d0-864f-58627aedaaff', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e6054f-effd-48bf-9ebc-ba75f4adb4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:55 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Volume volume-90d873d8-2265-47d0-864f-58627aedaaff (90d873d8-2265-47d0-864f-58627aedaaff): created successfully Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1e6054f-effd-48bf-9ebc-ba75f4adb4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:55 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Flow 'volume_create_manager' (efbb9128-064b-4fe5-866c-41f45b4d3abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad.7d8260b0-2077-443e-b57b-a5de30a89f69" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d213676c-ce01-49f7-9f0b-8270f9cec13c tempest-VolumesListAdminTestJSON-1513184701 None] Created volume successfully. Jul 06 15:37:55 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 0 in 2.557s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_6f6zf54udevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:37:55 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Converted 112.00 MB image at 43.78 MB/s Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-7d8260b0-2077-443e-b57b-a5de30a89f69" released by "_delete_snapshot" :: held 3.868s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" released by "delete_snapshot" :: held 3.906s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:55 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c 1G Jul 06 15:37:55 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Created reservations ['ce5178e8-905e-4b56-902e-36625eea0d8f', 'a61a439c-6a46-46c0-8b04-c68f5b27cb1c', 'e1c60497-c0f3-4ed7-b657-2ebce7ee32fe', '2fbd63cb-d3ed-4bf3-a4c4-428f24468719'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Delete snapshot completed successfully. Jul 06 15:37:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-020345ed-10ad-418e-bb14-d4b69a533977 tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-7d8260b0-2077-443e-b57b-a5de30a89f69-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-6dc2da8b-faae-4329-8620-95eabc6fb9ad-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-6dc2da8b-faae-4329-8620-95eabc6fb9ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b16a5a3-c6a9-4728-8969-11a99464f33a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:56 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad Jul 06 15:37:56 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:56 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c 1G" returned: 0 in 0.756s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7f5edc-93d6-4230-b7cf-ecc16fcac85f]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:37:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:56 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:37:56 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:57 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad" returned: 0 in 1.063s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:57 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad Jul 06 15:37:57 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Flow 'volume_create_manager' (cc86ddd5-6d90-4821-9c38-0d457148ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea943c8-9d24-45eb-a6fb-d471751425d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea943c8-9d24-45eb-a6fb-d471751425d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdeb637-dc2a-4c1d-9391-632fa0652264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74024c0991d74fe68ddf297efa382af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:57Z,use_quota=True,user_id='29ef8bf25e3540f98ed317628782974e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fa0f9b-cfcd-4364-99fb-3520ee976da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6fa0f9b-cfcd-4364-99fb-3520ee976da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f3719f-884f-490a-a3b6-a2d9316930ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f3719f-884f-490a-a3b6-a2d9316930ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acdeb637-dc2a-4c1d-9391-632fa0652264', 'volume_name': 'volume-acdeb637-dc2a-4c1d-9391-632fa0652264', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249cd3f1-fa88-4ccd-9967-234faf51c61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249cd3f1-fa88-4ccd-9967-234faf51c61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:57 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3f4d4a-c0d5-4fb5-b5cd-9b85f87634e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:57 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Volume acdeb637-dc2a-4c1d-9391-632fa0652264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acdeb637-dc2a-4c1d-9391-632fa0652264', 'volume_size': 1} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdeb637-dc2a-4c1d-9391-632fa0652264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74024c0991d74fe68ddf297efa382af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:37:57Z,use_quota=True,user_id='29ef8bf25e3540f98ed317628782974e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Creating volume acdeb637-dc2a-4c1d-9391-632fa0652264 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:37:57 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 0 in 1.239s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:57 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 1073741824 Jul 06 15:37:57 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:57 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:37:57 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:58 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6dc2da8b-faae-4329-8620-95eabc6fb9ad" returned: 0 in 0.888s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-quobyte-6dc2da8b-faae-4329-8620-95eabc6fb9ad" released by "delete_volume" :: held 2.028s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Created reservations ['8957fda0-1d86-4547-90fe-58037c8443e2', '402a166e-b354-45f9-ae40-60b8f3ad6830', 'a014e571-be42-4fbe-84f6-1836b3c0942f', '2e3877d7-e58b-465e-81d3-33455a1d152f'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:58 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:37:58 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:58 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 1 in 1.126s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Downloaded image 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume 0b3396aa-502f-420b-a34e-c51f0c47067c successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 for user eefcc5c6bdcf4629b63b4b1b8438fad3 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Marking volume 0b3396aa-502f-420b-a34e-c51f0c47067c as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Copying metadata from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 to 0b3396aa-502f-420b-a34e-c51f0c47067c. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Creating volume glance metadata for volume 0b3396aa-502f-420b-a34e-c51f0c47067c backed by image 9a5687fe-7bc5-4daa-b5b4-270d79910583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:37:58 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 1073741824" returned: 0 in 1.254s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42eef097-18ed-4692-b97e-4fffa59c6061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3396aa-502f-420b-a34e-c51f0c47067c', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42b7bf8-790e-4d5a-97c5-333d0a2876e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:58 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 Jul 06 15:37:58 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:37:58 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Volume volume-0b3396aa-502f-420b-a34e-c51f0c47067c (0b3396aa-502f-420b-a34e-c51f0c47067c): created successfully Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42b7bf8-790e-4d5a-97c5-333d0a2876e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (9fc14f2b-fcd4-4ff6-b819-4b6282c90859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:59 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9820da06-20cb-485b-9538-cde2e7855814 tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:37:59 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.847s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:37:59 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Deleted volume successfully. Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9f34873b-a3da-4451-8c54-b9745e93a99c tempest-VolumesSnapshotListTestJSON-219248648 None] Lock "cinder-6dc2da8b-faae-4329-8620-95eabc6fb9ad-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:37:59 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264" returned: 0 in 0.803s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3f4d4a-c0d5-4fb5-b5cd-9b85f87634e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acdeb637-dc2a-4c1d-9391-632fa0652264', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4788afa6-6679-40b9-876f-3f3a622d56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:37:59 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Volume volume-acdeb637-dc2a-4c1d-9391-632fa0652264 (acdeb637-dc2a-4c1d-9391-632fa0652264): created successfully Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4788afa6-6679-40b9-876f-3f3a622d56d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:37:59 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Flow 'volume_create_manager' (cc86ddd5-6d90-4821-9c38-0d457148ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:37:59 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ca8a2d61-a1c4-4f96-bdd9-fa5b70f58b8d tempest-VolumesListAdminTestJSON-1797058878 None] Created volume successfully. Jul 06 15:38:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Acquiring lock "cinder-acdeb637-dc2a-4c1d-9391-632fa0652264-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Lock "cinder-acdeb637-dc2a-4c1d-9391-632fa0652264-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Acquiring lock "cinder-quobyte-acdeb637-dc2a-4c1d-9391-632fa0652264" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Lock "cinder-quobyte-acdeb637-dc2a-4c1d-9391-632fa0652264" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (f99ff0fd-c945-4a3c-a304-022ae2cd16df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca9352e-9b15-4160-8fac-d429ac52dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81ee0f1-1259-4ac0-af67-1325483c6516]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "cinder-90d873d8-2265-47d0-864f-58627aedaaff-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca9352e-9b15-4160-8fac-d429ac52dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1500493465',display_name='tempest-VolumesGetTest-Volume-968101463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9198008-a52d-4a62-8954-60190c5e3db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:01Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e351f70c-e3e0-4fbf-ac37-d9dcca531e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e351f70c-e3e0-4fbf-ac37-d9dcca531e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51810df8-a098-4d0e-92b3-ef484d3337eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51810df8-a098-4d0e-92b3-ef484d3337eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9198008-a52d-4a62-8954-60190c5e3db3', 'volume_name': 'volume-d9198008-a52d-4a62-8954-60190c5e3db3', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a3365b-00c8-4346-80e5-a080a2f82146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a3365b-00c8-4346-80e5-a080a2f82146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b55d7e-7197-4aeb-b816-5bf9de2d0c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Volume d9198008-a52d-4a62-8954-60190c5e3db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9198008-a52d-4a62-8954-60190c5e3db3', 'volume_size': 1} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1500493465',display_name='tempest-VolumesGetTest-Volume-968101463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9198008-a52d-4a62-8954-60190c5e3db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70228e2d79864fec991caff18e89767f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:01Z,use_quota=True,user_id='eefcc5c6bdcf4629b63b4b1b8438fad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Creating volume d9198008-a52d-4a62-8954-60190c5e3db3 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:01 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-90d873d8-2265-47d0-864f-58627aedaaff-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:01 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 1073741824 Jul 06 15:38:01 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:01 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 Jul 06 15:38:01 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "cinder-quobyte-90d873d8-2265-47d0-864f-58627aedaaff" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-quobyte-90d873d8-2265-47d0-864f-58627aedaaff" acquired by "delete_volume" :: waited 0.041s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[13354099-283a-46a0-bb1f-d502a09b53ab]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:01 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff Jul 06 15:38:01 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:02 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264" returned: 0 in 1.138s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:02 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264 Jul 06 15:38:02 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:02 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff" returned: 0 in 1.229s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:02 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 1073741824" returned: 0 in 1.437s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:02 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff Jul 06 15:38:02 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:02 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 Jul 06 15:38:02 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:03 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-acdeb637-dc2a-4c1d-9391-632fa0652264" returned: 0 in 1.329s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Lock "cinder-quobyte-acdeb637-dc2a-4c1d-9391-632fa0652264" released by "delete_volume" :: held 2.605s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Created reservations ['f25d4d65-8666-4ec0-b410-f509b71efae5', '0bd5c15b-b886-4fd4-bf52-10fe1669ca03', '0802c506-e35f-4178-81a8-63bd20b97b77', 'f6c01678-52af-4716-bd04-0d1498cd6809'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:03 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-90d873d8-2265-47d0-864f-58627aedaaff" returned: 0 in 1.191s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-quobyte-90d873d8-2265-47d0-864f-58627aedaaff" released by "delete_volume" :: held 2.510s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:03 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:03 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Created reservations ['463ce0ed-0b5d-4c83-8b3a-c984334e7003', 'b0355401-3784-4d2e-b1a0-39d73af8a7c5', '55f00183-de1d-4024-bea0-8f2127661fe0', '4d3e703d-0358-4d9c-8042-ae74fb60d501'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:03 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3" returned: 0 in 1.294s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] <== create_volume: return (2815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.817s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b55d7e-7197-4aeb-b816-5bf9de2d0c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9198008-a52d-4a62-8954-60190c5e3db3', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb888f7-b75d-457d-aba9-3701f977806f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Volume volume-d9198008-a52d-4a62-8954-60190c5e3db3 (d9198008-a52d-4a62-8954-60190c5e3db3): created successfully Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb888f7-b75d-457d-aba9-3701f977806f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Flow 'volume_create_manager' (f99ff0fd-c945-4a3c-a304-022ae2cd16df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-eec0a105-61a5-4946-8c49-480c8030186c tempest-VolumesGetTest-704373642 None] Created volume successfully. Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:04 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:04 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-d9198008-a52d-4a62-8954-60190c5e3db3-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Lock "cinder-d9198008-a52d-4a62-8954-60190c5e3db3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-d9198008-a52d-4a62-8954-60190c5e3db3" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-d9198008-a52d-4a62-8954-60190c5e3db3" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "cinder-603a070c-0a15-42f7-b9a9-29a71dd11fe4-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c5a401-5d59-47c7-b601-1d760e90caf6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-603a070c-0a15-42f7-b9a9-29a71dd11fe4-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "cinder-quobyte-603a070c-0a15-42f7-b9a9-29a71dd11fe4" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-quobyte-603a070c-0a15-42f7-b9a9-29a71dd11fe4" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4004a0be-fcaa-42dc-b5a8-cbc6d2d94933]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:05 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 Jul 06 15:38:05 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:05 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.324s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Deleted volume successfully. Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6710d797-c3e3-40b6-a0a8-b27dc586d7f1 tempest-VolumesListAdminTestJSON-1797058878 None] Lock "cinder-acdeb637-dc2a-4c1d-9391-632fa0652264-delete_volume" released by "delete_volume" :: held 4.339s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:05 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 Jul 06 15:38:05 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:05 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.160s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Deleted volume successfully. Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c27a1db2-7c2a-4998-8624-052c8040a8f1 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-90d873d8-2265-47d0-864f-58627aedaaff-delete_volume" released by "delete_volume" :: held 4.114s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:05 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3" returned: 0 in 1.146s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:05 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3 Jul 06 15:38:05 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:06 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4" returned: 0 in 1.310s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:06 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4 Jul 06 15:38:06 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:06 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d9198008-a52d-4a62-8954-60190c5e3db3" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-d9198008-a52d-4a62-8954-60190c5e3db3" released by "delete_volume" :: held 2.063s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:06 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:06 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:06 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Created reservations ['96761eb3-2fea-486d-ac5c-2850e678c238', 'fe64ec61-7c42-4602-811d-ed3261a060b5', 'd9f6adc7-007d-4bab-b566-7be260e53da4', 'de923ecd-f883-4153-b55e-6030a325537f'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:07 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:07 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:07 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-603a070c-0a15-42f7-b9a9-29a71dd11fe4" returned: 0 in 1.132s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-quobyte-603a070c-0a15-42f7-b9a9-29a71dd11fe4" released by "delete_volume" :: held 2.533s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Created reservations ['113fa817-173a-47d5-9298-b6097644b4c0', 'ab7dcbc5-e845-4b6f-b7cb-98f3eaac6afa', 'd2ce37dd-4e05-437d-a2c5-26b8bbdc6f48', 'db16ac39-88ec-4807-a660-26159368ed7c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:07 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:07 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:08 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.330s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:38:08 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.174s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1a69295b-a53d-4712-b423-ca4029afec00 tempest-VolumesGetTest-704373642 None] Lock "cinder-d9198008-a52d-4a62-8954-60190c5e3db3-delete_volume" released by "delete_volume" :: held 3.706s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-0b3396aa-502f-420b-a34e-c51f0c47067c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "cinder-274a1601-27b7-4623-80af-7fe73c00ab0d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Lock "cinder-0b3396aa-502f-420b-a34e-c51f0c47067c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-274a1601-27b7-4623-80af-7fe73c00ab0d-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Acquiring lock "cinder-quobyte-0b3396aa-502f-420b-a34e-c51f0c47067c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "cinder-quobyte-274a1601-27b7-4623-80af-7fe73c00ab0d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-0b3396aa-502f-420b-a34e-c51f0c47067c" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-quobyte-274a1601-27b7-4623-80af-7fe73c00ab0d" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[577c40bf-3c84-486e-a344-5a1e6a13e799]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a3586a-d9bf-4de8-889b-8756f7f13594]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:08 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:38:08 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:08 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d Jul 06 15:38:08 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:08 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.232s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Deleted volume successfully. Jul 06 15:38:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f98f6a0f-720b-4510-862d-0d8cc59f3fc4 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-603a070c-0a15-42f7-b9a9-29a71dd11fe4-delete_volume" released by "delete_volume" :: held 4.161s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:09 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d" returned: 0 in 1.080s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:09 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d Jul 06 15:38:09 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:09 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 0 in 1.144s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:10 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:38:10 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:10 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-274a1601-27b7-4623-80af-7fe73c00ab0d" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-quobyte-274a1601-27b7-4623-80af-7fe73c00ab0d" released by "delete_volume" :: held 2.001s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Created reservations ['6ded41d2-2313-4dec-8246-44a8aeb4a35c', 'f8afce5b-6da5-45b7-b0cf-fc1fca802712', '35fe87af-6cc9-424f-8473-769eb4122efb', '26ba5a56-bdd3-4e66-b6f0-6addef47a94f'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:10 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:10 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:10 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 1 in 1.078s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:10 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c Jul 06 15:38:10 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:11 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:11 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Deleted volume successfully. Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=116,cinder:UPDATE=155,cinder:INSERT=38,cinder:DELETE=12 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c2c688ad-9384-4983-a5a6-226d7f633687 tempest-VolumesListAdminTestJSON-1513184701 None] Lock "cinder-274a1601-27b7-4623-80af-7fe73c00ab0d-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:11 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0b3396aa-502f-420b-a34e-c51f0c47067c" returned: 0 in 1.050s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Lock "cinder-quobyte-0b3396aa-502f-420b-a34e-c51f0c47067c" released by "delete_volume" :: held 3.369s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:11 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=128,cinder:UPDATE=141,cinder:INSERT=49,cinder:DELETE=12 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Created reservations ['fa6eeaef-1468-4437-a994-554bb1cb8978', '7a70bebc-a262-4a39-bfa8-f231dcdaacc6', 'eac9a9cf-2119-4812-97b7-3fa6a72899a7', 'cd3aaf24-f3b5-4fce-ace5-d1cea3d602b4'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:12 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:12 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:12 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.858s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:13 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Deleted volume successfully. Jul 06 15:38:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fd87f456-a2c0-4026-af64-9661e9eae348 tempest-VolumesGetTest-704373642 None] Lock "cinder-0b3396aa-502f-420b-a34e-c51f0c47067c-delete_volume" released by "delete_volume" :: held 4.566s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Flow 'volume_create_manager' (17908b68-c4bb-40aa-a98e-c5c4b215b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b0276d-e8f7-439b-9d3c-34cc710b53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b0276d-e8f7-439b-9d3c-34cc710b53ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1107894649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cd71a6-879a-4811-aa2b-ed85c7c29dda,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1863a25d61c64adc8f851c7d290c1af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:19Z,use_quota=True,user_id='0674e28073cb4a68b2bd0b63376713f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c3dcdc-5b0a-4447-b56d-7b8857d107ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c3dcdc-5b0a-4447-b56d-7b8857d107ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d9ca11-e3dd-4e5d-983d-ba4978f66864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d9ca11-e3dd-4e5d-983d-ba4978f66864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1cd71a6-879a-4811-aa2b-ed85c7c29dda', 'volume_name': 'volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f897cdb-3e23-470f-ae11-c6dcf91ea7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f897cdb-3e23-470f-ae11-c6dcf91ea7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023438fc-4b9e-4c22-9ea6-e545b73db201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:19 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Volume f1cd71a6-879a-4811-aa2b-ed85c7c29dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda', 'volume_size': 1} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1107894649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1cd71a6-879a-4811-aa2b-ed85c7c29dda,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1863a25d61c64adc8f851c7d290c1af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:19Z,use_quota=True,user_id='0674e28073cb4a68b2bd0b63376713f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Creating volume f1cd71a6-879a-4811-aa2b-ed85c7c29dda {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:19 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:19 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda 1073741824 Jul 06 15:38:19 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:20 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda 1073741824" returned: 0 in 1.164s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:20 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda Jul 06 15:38:20 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:21 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda" returned: 0 in 1.193s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (023438fc-4b9e-4c22-9ea6-e545b73db201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318d4f50-c860-45ca-bbc1-0f99c25d566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:22 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Volume volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda (f1cd71a6-879a-4811-aa2b-ed85c7c29dda): created successfully Jul 06 15:38:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (318d4f50-c860-45ca-bbc1-0f99c25d566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Flow 'volume_create_manager' (17908b68-c4bb-40aa-a98e-c5c4b215b88b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e8766c15-efc5-469a-add7-f991e6d4f727 tempest-VolumesListTestJSON-293605270 None] Created volume successfully. Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Flow 'volume_create_manager' (58ca660f-45e1-4253-ba8e-2e5ae9a136b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb343c82-240e-4730-b407-36a7602278f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb343c82-240e-4730-b407-36a7602278f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1235893993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6533d5bc-50df-4fd3-9b46-007cdbbe516f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1863a25d61c64adc8f851c7d290c1af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:23Z,use_quota=True,user_id='0674e28073cb4a68b2bd0b63376713f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57115c0-3d87-4e78-977c-28cd34ce44f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57115c0-3d87-4e78-977c-28cd34ce44f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19187ac5-5527-44e3-8992-a6a55c6d1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19187ac5-5527-44e3-8992-a6a55c6d1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6533d5bc-50df-4fd3-9b46-007cdbbe516f', 'volume_name': 'volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b312fb9-f9f0-4305-88c1-1e0e733e5be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b312fb9-f9f0-4305-88c1-1e0e733e5be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60bab46-0b6a-4d1a-bc68-1c91992b1237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Volume 6533d5bc-50df-4fd3-9b46-007cdbbe516f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f', 'volume_size': 1} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1235893993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6533d5bc-50df-4fd3-9b46-007cdbbe516f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1863a25d61c64adc8f851c7d290c1af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:23Z,use_quota=True,user_id='0674e28073cb4a68b2bd0b63376713f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Creating volume 6533d5bc-50df-4fd3-9b46-007cdbbe516f {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:23 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:23 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f 1073741824 Jul 06 15:38:23 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:24 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f 1073741824" returned: 0 in 1.158s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:24 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f Jul 06 15:38:24 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:25 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f" returned: 0 in 0.841s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60bab46-0b6a-4d1a-bc68-1c91992b1237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6abb0e-9bc8-4c34-95da-0e95fb97bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Volume volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f (6533d5bc-50df-4fd3-9b46-007cdbbe516f): created successfully Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d6abb0e-9bc8-4c34-95da-0e95fb97bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Flow 'volume_create_manager' (58ca660f-45e1-4253-ba8e-2e5ae9a136b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-98ff8d8e-69e7-4d6f-bfef-4af244ce12a1 tempest-VolumesListTestJSON-293605270 None] Created volume successfully. Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Flow 'volume_create_manager' (9b56176d-a11f-4aa3-b9d0-d2e6605f1668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ff4757-a78b-4dba-9570-49461e473ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ff4757-a78b-4dba-9570-49461e473ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-619008536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f1d340-150b-4f0b-a89e-a78a7366555f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1863a25d61c64adc8f851c7d290c1af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:27Z,use_quota=True,user_id='0674e28073cb4a68b2bd0b63376713f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d34e0b3-356b-4113-86e7-174322d598fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d34e0b3-356b-4113-86e7-174322d598fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a922bb-b42d-4bed-85b8-16fa61387da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a922bb-b42d-4bed-85b8-16fa61387da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11f1d340-150b-4f0b-a89e-a78a7366555f', 'volume_name': 'volume-11f1d340-150b-4f0b-a89e-a78a7366555f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1dbdbe-424d-4a36-b6ed-29a75d1f6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f1dbdbe-424d-4a36-b6ed-29a75d1f6726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00343270-7620-486c-85d3-8a14c70be6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Volume 11f1d340-150b-4f0b-a89e-a78a7366555f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11f1d340-150b-4f0b-a89e-a78a7366555f', 'volume_size': 1} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-619008536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11f1d340-150b-4f0b-a89e-a78a7366555f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1863a25d61c64adc8f851c7d290c1af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:27Z,use_quota=True,user_id='0674e28073cb4a68b2bd0b63376713f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Creating volume 11f1d340-150b-4f0b-a89e-a78a7366555f {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:27 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:27 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f 1073741824 Jul 06 15:38:27 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:28 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f 1073741824" returned: 0 in 1.241s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:28 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:28 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f Jul 06 15:38:28 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Flow 'volume_create_manager' (5ac4fb43-798b-4177-941c-3a19d3c0ef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367c78f6-e26c-4fbb-9307-a389b2830a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367c78f6-e26c-4fbb-9307-a389b2830a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1800374900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55a1fec-433e-4052-9fa1-0598a76b3e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a351fa4f7f84928b5602f5f256e9d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:29Z,use_quota=True,user_id='5a48de5792df46aaa3c964c980665a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29da2172-bbc5-4fc7-b3e7-8a3c87cee11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29da2172-bbc5-4fc7-b3e7-8a3c87cee11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae657e5-345f-4dc9-a868-f461f14987ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae657e5-345f-4dc9-a868-f461f14987ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55a1fec-433e-4052-9fa1-0598a76b3e4c', 'volume_name': 'volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65556879-3700-410a-9277-b42eb50aede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65556879-3700-410a-9277-b42eb50aede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1462f61b-13cc-4375-88ef-34d60f7ef747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Volume a55a1fec-433e-4052-9fa1-0598a76b3e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c', 'volume_size': 1} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:29 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f" returned: 0 in 0.781s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1800374900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55a1fec-433e-4052-9fa1-0598a76b3e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a351fa4f7f84928b5602f5f256e9d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:29Z,use_quota=True,user_id='5a48de5792df46aaa3c964c980665a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Creating volume a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:29 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:29 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c 1073741824 Jul 06 15:38:29 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00343270-7620-486c-85d3-8a14c70be6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11f1d340-150b-4f0b-a89e-a78a7366555f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee43f05-a601-428f-8cb9-8533b9bdd38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Volume volume-11f1d340-150b-4f0b-a89e-a78a7366555f (11f1d340-150b-4f0b-a89e-a78a7366555f): created successfully Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee43f05-a601-428f-8cb9-8533b9bdd38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Flow 'volume_create_manager' (9b56176d-a11f-4aa3-b9d0-d2e6605f1668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5f464f8b-94ef-47d7-bdd5-4bd8a28bceae tempest-VolumesListTestJSON-293605270 None] Created volume successfully. Jul 06 15:38:30 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c 1073741824" returned: 0 in 0.911s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:30 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c Jul 06 15:38:30 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Flow 'volume_create_manager' (e789a4da-08d8-4632-8470-8885c18752ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62097419-ca97-4d6c-bae5-2f849d2be0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62097419-ca97-4d6c-bae5-2f849d2be0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2141978219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df7535e-8ea3-4388-9fa2-3950269c5cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b9d42e7dfb4de6bf3f611dc1e2d70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:31Z,use_quota=True,user_id='8e04a8ea015940c9b2c679d91bcdda28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a6571b-6404-4bac-a22b-7dc6cdb0ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a6571b-6404-4bac-a22b-7dc6cdb0ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c3bd70-a91f-4d74-9874-4a2db4d69348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:38:31 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c" returned: 0 in 0.987s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1462f61b-13cc-4375-88ef-34d60f7ef747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016fb0ce-bd92-45ea-9089-619421235c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Volume volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c (a55a1fec-433e-4052-9fa1-0598a76b3e4c): created successfully Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016fb0ce-bd92-45ea-9089-619421235c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Flow 'volume_create_manager' (5ac4fb43-798b-4177-941c-3a19d3c0ef35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-33ce9f2b-1827-4ec5-a997-f24b8213f902 tempest-VolumesDeleteCascade-359499570 None] Created volume successfully. Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c3bd70-a91f-4d74-9874-4a2db4d69348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1df7535e-8ea3-4388-9fa2-3950269c5cf2', 'volume_name': 'volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14235671-8618-4b06-9146-3e9790322b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14235671-8618-4b06-9146-3e9790322b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7b6a03-9f9b-4690-bac1-4cc0dc198a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Volume 1df7535e-8ea3-4388-9fa2-3950269c5cf2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Trying to clone 1df7535e-8ea3-4388-9fa2-3950269c5cf2 from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Creating offline snapshot ca3be434-45da-434a-a3e2-c5c11c13952f of volume a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64580a3-be2e-4a98-8451-450d38468407]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:32 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c Jul 06 15:38:32 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:38:32 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Image download 20.69 MB at 20.69 MB/s Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90a0122-b4da-4464-ae6c-38a05fb20df7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:33 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD Jul 06 15:38:33 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:33 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c" returned: 0 in 1.196s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:33 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f 1G Jul 06 15:38:33 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "cinder-11f1d340-150b-4f0b-a89e-a78a7366555f-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-11f1d340-150b-4f0b-a89e-a78a7366555f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:34 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "cinder-quobyte-11f1d340-150b-4f0b-a89e-a78a7366555f" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD" returned: 0 in 1.189s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 is fetched for user 8e04a8ea015940c9b2c679d91bcdda28. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-quobyte-11f1d340-150b-4f0b-a89e-a78a7366555f" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09079b-a5b1-4e92-a3f9-be275f3dff69]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a53fe8e-32dc-4814-8521-e317018c8215]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:34 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f Jul 06 15:38:34 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:34 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD Jul 06 15:38:34 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:35 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f 1G" returned: 0 in 1.301s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:35 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:35 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:35 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f" returned: 0 in 1.301s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:35 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f Jul 06 15:38:35 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:35 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD" returned: 0 in 1.318s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:35 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 0.859s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:35 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f is being set with open permissions: ugo+rw Jul 06 15:38:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:35 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:35 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:36 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-11f1d340-150b-4f0b-a89e-a78a7366555f" returned: 0 in 0.753s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-quobyte-11f1d340-150b-4f0b-a89e-a78a7366555f" released by "delete_volume" :: held 2.121s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Created reservations ['de4d7869-5e66-45e3-b50c-d5fdd48f2f5e', '554c0ecf-d2f5-4ece-a083-bfb2aa27317c', 'd46670ff-7180-45f0-bb8c-2ed9ccf4fdd6', 'f4bfc580-2bc0-4a93-b063-6dea99c1a397'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:36 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:36 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:36 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:36 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info Jul 06 15:38:36 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:37 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.859s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Deleted volume successfully. Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-387e7bb9-ae76-4367-9189-8d0b4a886e58 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-11f1d340-150b-4f0b-a89e-a78a7366555f-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "cinder-6533d5bc-50df-4fd3-9b46-007cdbbe516f-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-6533d5bc-50df-4fd3-9b46-007cdbbe516f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "cinder-quobyte-6533d5bc-50df-4fd3-9b46-007cdbbe516f" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-quobyte-6533d5bc-50df-4fd3-9b46-007cdbbe516f" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ac7dbb-fc3e-4cbf-830b-76276b6b7a95]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:37 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f Jul 06 15:38:37 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:37 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info" returned: 0 in 0.993s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:37 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info is being set with open permissions: ugo+rw Jul 06 15:38:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:37 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info Jul 06 15:38:37 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.info" returned: 0 in 0.670s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.065s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.024s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2141978219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df7535e-8ea3-4388-9fa2-3950269c5cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b9d42e7dfb4de6bf3f611dc1e2d70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:31Z,use_quota=True,user_id='8e04a8ea015940c9b2c679d91bcdda28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Creating volume 1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:38 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:38 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:38 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 1073741824 Jul 06 15:38:38 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f" returned: 0 in 0.878s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:38 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f Jul 06 15:38:38 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6e749961-3772-445a-9494-b4466c1dfbba tempest-VolumesDeleteCascade-359499570 None] Create snapshot completed successfully Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Flow 'volume_create_manager' (c652d556-81a1-4b4f-b045-68211781ab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198cf698-f2b2-4c1f-a727-65dd761bf2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (198cf698-f2b2-4c1f-a727-65dd761bf2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1163289007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc7167-3c4d-4c29-b456-9e2ec760dc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ba4328393048faae35a83848db1983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:38Z,use_quota=True,user_id='075dda282f264e65a9261bb1fadf98d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542c87d7-6a4d-4ec1-82ef-53f864d45de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542c87d7-6a4d-4ec1-82ef-53f864d45de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ded885c-70b7-48cc-887d-52b4eb3af0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ded885c-70b7-48cc-887d-52b4eb3af0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdc7167-3c4d-4c29-b456-9e2ec760dc8a', 'volume_name': 'volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a980d650-752b-42b0-a2e5-4e46bf75b2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a980d650-752b-42b0-a2e5-4e46bf75b2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641e59b5-e00a-4353-b28d-f04b8c16eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:38 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Volume bcdc7167-3c4d-4c29-b456-9e2ec760dc8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a', 'volume_size': 1} Jul 06 15:38:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Flow 'volume_create_manager' (717f1357-4ec6-431c-afa1-4da8ee177b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe1bcfb-953f-46fc-a615-e3e2a01796b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe1bcfb-953f-46fc-a615-e3e2a01796b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-984161442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b612660-dd61-4f64-b02f-4215402a80b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ba4328393048faae35a83848db1983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:39Z,use_quota=True,user_id='075dda282f264e65a9261bb1fadf98d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480a87a4-4368-4604-b172-82873a9849ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480a87a4-4368-4604-b172-82873a9849ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaa05c2-d083-4bc7-8c68-1d75f1ae5c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eaa05c2-d083-4bc7-8c68-1d75f1ae5c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b612660-dd61-4f64-b02f-4215402a80b9', 'volume_name': 'volume-6b612660-dd61-4f64-b02f-4215402a80b9', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5869fa-b55f-4ee3-85b9-73579e738892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5869fa-b55f-4ee3-85b9-73579e738892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66569777-d53b-4667-be2b-6b5412316f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:39 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Volume 6b612660-dd61-4f64-b02f-4215402a80b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b612660-dd61-4f64-b02f-4215402a80b9', 'volume_size': 1} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:39 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6533d5bc-50df-4fd3-9b46-007cdbbe516f" returned: 0 in 0.873s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-quobyte-6533d5bc-50df-4fd3-9b46-007cdbbe516f" released by "delete_volume" :: held 1.803s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Created reservations ['41f18bb8-7386-482e-9cc5-cd18efd777e9', '5373008d-9a0d-49e2-bcda-f1db000021bc', '7c8ad464-8607-4a38-a35a-d93083c61057', '67e6e772-b1fa-4b92-b293-1d43853aae9c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:39 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:39 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:39 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 1073741824" returned: 0 in 1.176s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:39 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:38:39 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "cinder-f1cd71a6-879a-4811-aa2b-ed85c7c29dda-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-f1cd71a6-879a-4811-aa2b-ed85c7c29dda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "cinder-quobyte-f1cd71a6-879a-4811-aa2b-ed85c7c29dda" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-quobyte-f1cd71a6-879a-4811-aa2b-ed85c7c29dda" acquired by "delete_volume" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a008d01-b7cc-40b3-a7fb-0049676d989c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:40 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda Jul 06 15:38:40 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:40 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Deleted volume successfully. Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-48327f12-8580-4f21-9d97-4f19ebc176f5 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-6533d5bc-50df-4fd3-9b46-007cdbbe516f-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:40 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 0.892s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1163289007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc7167-3c4d-4c29-b456-9e2ec760dc8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ba4328393048faae35a83848db1983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:38Z,use_quota=True,user_id='075dda282f264e65a9261bb1fadf98d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Creating volume bcdc7167-3c4d-4c29-b456-9e2ec760dc8a {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:40 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:40 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a 1073741824 Jul 06 15:38:40 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Attempting download of 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume 1df7535e-8ea3-4388-9fa2-3950269c5cf2. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8607a070-8d1a-4d37-8718-313185afb3c7]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:40 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68 Jul 06 15:38:40 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:41 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda" returned: 0 in 0.919s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:41 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda Jul 06 15:38:41 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:41 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68" returned: 0 in 0.883s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:41 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a 1073741824" returned: 0 in 1.013s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:41 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a Jul 06 15:38:41 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:41 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68 Jul 06 15:38:41 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:41 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f1cd71a6-879a-4811-aa2b-ed85c7c29dda" returned: 0 in 0.949s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-quobyte-f1cd71a6-879a-4811-aa2b-ed85c7c29dda" released by "delete_volume" :: held 1.941s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Created reservations ['5d5ac1c8-2e40-4bf0-a753-4686988977c5', 'c1b7c61b-9521-4bac-a042-e42c59553fb2', 'c3917aba-790d-4b0b-b106-82bb6e8085e8', '739b36b4-709d-4b33-8faf-35e0df11244e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:42 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:38:42 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:42 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68" returned: 1 in 1.088s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a5687fe-7bc5-4daa-b5b4-270d79910583_mtsdko68' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad40e2-a4c9-4f28-9289-8f6b91aef1cc]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:42 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" returned: 0 in 1.059s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.495s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641e59b5-e00a-4353-b28d-f04b8c16eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd3bb44-1519-4022-921b-55cc3884c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Creating offline snapshot 9e36449e-76fd-4eed-b74d-87e8c7f9169a of volume a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:38:42 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD Jul 06 15:38:42 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Volume volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a (bcdc7167-3c4d-4c29-b456-9e2ec760dc8a): created successfully Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd3bb44-1519-4022-921b-55cc3884c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Flow 'volume_create_manager' (c652d556-81a1-4b4f-b045-68211781ab06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[20227ea9-5fa3-481a-80aa-b24ff44a6ed4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4801b3d9-db2c-49be-a7aa-6172a3a91ad3 tempest-TestServerVolumeAttachmentScenario-787770676 None] Created volume successfully. Jul 06 15:38:43 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.012s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:43 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:38:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Deleted volume successfully. Jul 06 15:38:43 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:43 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbe9329c-83f5-4ff3-8203-6782f0fa1064 tempest-VolumesListTestJSON-293605270 None] Lock "cinder-f1cd71a6-879a-4811-aa2b-ed85c7c29dda-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:43 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD" returned: 0 in 1.048s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:43 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] 9a5687fe-7bc5-4daa-b5b4-270d79910583 was qcow2, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:38:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:43 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:38:43 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:44 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 1.213s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:38:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:44 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a 1G Jul 06 15:38:44 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:45 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a 1G" returned: 0 in 1.154s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:45 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a Jul 06 15:38:45 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:46 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a is being set with open permissions: ugo+rw Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:46 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a Jul 06 15:38:46 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 2.354s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a5687fe-7bc5-4daa-b5b4-270d79910583_oe85o134devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:38:46 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Converted 112.00 MB image at 47.55 MB/s Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:46 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 1G Jul 06 15:38:46 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a" returned: 0 in 0.795s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.152s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.575s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-984161442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b612660-dd61-4f64-b02f-4215402a80b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ba4328393048faae35a83848db1983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:38:39Z,use_quota=True,user_id='075dda282f264e65a9261bb1fadf98d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Creating volume 6b612660-dd61-4f64-b02f-4215402a80b9 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:38:46 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:38:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:46 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 1073741824 Jul 06 15:38:46 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-843a9d80-f27d-4fcf-990b-d5265781b81f tempest-VolumesDeleteCascade-359499570 None] Create snapshot completed successfully Jul 06 15:38:47 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 1G" returned: 0 in 0.903s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3c68b-7b0d-4b79-8037-d01b8188ffcf]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:47 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:38:47 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-a55a1fec-433e-4052-9fa1-0598a76b3e4c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-a55a1fec-433e-4052-9fa1-0598a76b3e4c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Performing cascade delete. {{(pid=86191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-9e36449e-76fd-4eed-b74d-87e8c7f9169a-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-9e36449e-76fd-4eed-b74d-87e8c7f9169a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-9e36449e-76fd-4eed-b74d-87e8c7f9169a" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-9e36449e-76fd-4eed-b74d-87e8c7f9169a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Deleting offline snapshot 9e36449e-76fd-4eed-b74d-87e8c7f9169a of volume a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] snapshot_file for this snap is: volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1981da-0035-4b84-b790-7a25058e6b92]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:48 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a Jul 06 15:38:48 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:48 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 0.983s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:48 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 1073741824" returned: 0 in 1.229s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:48 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:38:48 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:48 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 Jul 06 15:38:48 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:49 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 1 in 1.164s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Downloaded image 9a5687fe-7bc5-4daa-b5b4-270d79910583 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}])) to volume 1df7535e-8ea3-4388-9fa2-3950269c5cf2 successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Temporary image 9a5687fe-7bc5-4daa-b5b4-270d79910583 for user 8e04a8ea015940c9b2c679d91bcdda28 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Marking volume 1df7535e-8ea3-4388-9fa2-3950269c5cf2 as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Copying metadata from image 9a5687fe-7bc5-4daa-b5b4-270d79910583 to 1df7535e-8ea3-4388-9fa2-3950269c5cf2. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Creating volume glance metadata for volume 1df7535e-8ea3-4388-9fa2-3950269c5cf2 backed by image 9a5687fe-7bc5-4daa-b5b4-270d79910583 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:38:49 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9" returned: 0 in 1.089s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66569777-d53b-4667-be2b-6b5412316f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b612660-dd61-4f64-b02f-4215402a80b9', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4def5175-4753-491d-8fc7-2d3a6663ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Volume volume-6b612660-dd61-4f64-b02f-4215402a80b9 (6b612660-dd61-4f64-b02f-4215402a80b9): created successfully Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4def5175-4753-491d-8fc7-2d3a6663ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Flow 'volume_create_manager' (717f1357-4ec6-431c-afa1-4da8ee177b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:49 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a" returned: 0 in 1.566s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc9402-cca3-4f68-926c-33faf02566ba]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-62bf4eb2-a34d-4c0c-96fd-ab19ff9f9f8f tempest-TestServerVolumeAttachmentScenario-787770676 None] Created volume successfully. Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7b6a03-9f9b-4690-bac1-4cc0dc198a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2', 'volume_size': 1, 'image_id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a5687fe-7bc5-4daa-b5b4-270d79910583', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '55e60bcee6364f4ea8cf01e20534e20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a5687fe-7bc5-4daa-b5b4-270d79910583', 'created_at': datetime.datetime(2026, 7, 6, 13, 20, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a5687fe-7bc5-4daa-b5b4-270d79910583/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd9d5cb-4651-4151-8638-54c06e183690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:38:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Volume volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 (1df7535e-8ea3-4388-9fa2-3950269c5cf2): created successfully Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abd9d5cb-4651-4151-8638-54c06e183690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:38:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Flow 'volume_create_manager' (e789a4da-08d8-4632-8470-8885c18752ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:38:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-530b96d4-73a5-4951-a1fc-20389d867a0f tempest-TestShelveInstance-1102387538 None] Created volume successfully. Jul 06 15:38:49 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:49 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:50 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 0.988s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:38:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:50 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a Jul 06 15:38:50 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:51 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a" returned: 0 in 1.096s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:51 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a Jul 06 15:38:51 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:52 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.9e36449e-76fd-4eed-b74d-87e8c7f9169a" returned: 0 in 0.918s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-9e36449e-76fd-4eed-b74d-87e8c7f9169a" released by "_delete_snapshot" :: held 4.694s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" released by "delete_snapshot" :: held 4.724s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Created reservations ['d7423f76-bb7b-4f21-b14b-cff760852880', '4acb3b87-f945-4bfb-b218-897b3212120b', '2f5d5358-d340-4f93-a9fb-eb63c43777a4', '76a7f182-cb78-4996-8f9f-49b81417df38'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Delete snapshot completed successfully. Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-9e36449e-76fd-4eed-b74d-87e8c7f9169a-delete_snapshot" released by "delete_snapshot" :: held 4.937s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-ca3be434-45da-434a-a3e2-c5c11c13952f-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-ca3be434-45da-434a-a3e2-c5c11c13952f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-ca3be434-45da-434a-a3e2-c5c11c13952f" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-ca3be434-45da-434a-a3e2-c5c11c13952f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Deleting offline snapshot ca3be434-45da-434a-a3e2-c5c11c13952f of volume a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] snapshot_file for this snap is: volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab39323-d241-4361-b3be-630baac39c2e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:52 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:52 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:53 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 0.915s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:38:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[89025225-09b0-4ebc-86c6-3d6f271be885]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:53 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c Jul 06 15:38:53 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:54 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c" returned: 0 in 1.130s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:54 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:54 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:55 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 1.036s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:55 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f Jul 06 15:38:55 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:56 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 06 15:38:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c.ca3be434-45da-434a-a3e2-c5c11c13952f" returned: 0 in 0.961s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:38:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-ca3be434-45da-434a-a3e2-c5c11c13952f" released by "_delete_snapshot" :: held 4.215s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" released by "delete_snapshot" :: held 4.255s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Created reservations ['4974fc60-fef3-4a56-9303-1813f6d09059', 'e43f7737-0f91-4696-93f8-c9d6d0ec4c45', 'ceffc78b-623c-4843-9555-713e5be5ecd1', '62153692-9b9d-47b4-8849-9ca7379e9353'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:38:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Delete snapshot completed successfully. Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-ca3be434-45da-434a-a3e2-c5c11c13952f-delete_snapshot" released by "delete_snapshot" :: held 4.567s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Snapshots deleted, issuing volume delete {{(pid=86191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f110eb-d897-45a3-84ef-ee19f6f60a37]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:57 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c Jul 06 15:38:57 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:38:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:38:58 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cf1c34-f2f3-47df-88ec-b290ba8a4bb8]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:38:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:38:58 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:38:58 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:38:59 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c" returned: 0 in 2.633s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:00 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c Jul 06 15:39:00 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:00 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 1.602s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:00 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:39:00 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:01 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a55a1fec-433e-4052-9fa1-0598a76b3e4c" returned: 0 in 1.403s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:01 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-a55a1fec-433e-4052-9fa1-0598a76b3e4c" released by "delete_volume" :: held 4.173s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 1 in 1.282s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.029s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5047830c-111a-401c-abf1-9fbf695e86e2', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Created reservations ['989fa547-d35e-4f1a-bfc9-c85a7458ac41', '7d1ecf78-191b-4cf3-be39-33e30f8900ce', '0f09e2d9-4590-4117-b495-d6c2b8db3dc7', '1b6dfabb-5aad-40b6-bc10-d8bb04fda621'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-4aabf2f1-be72-43ab-bb1d-0e6f4d3df3fa req-66dae5ac-86bb-410a-be5c-a24e9b0d3de2 tempest-TestShelveInstance-1102387538 None] attachment_update completed successfully. Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:01 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:39:01 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:03 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.299s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:03 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Deleted volume successfully. Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f75e3822-e962-450a-a41b-8b23d33eefb4 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-a55a1fec-433e-4052-9fa1-0598a76b3e4c-delete_volume" released by "delete_volume" :: held 15.522s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Flow 'volume_create_manager' (8f1c4301-3d72-4b9c-9168-1d68f5b0fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d2275-8e2b-4da9-a863-bbbaa5acea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d2275-8e2b-4da9-a863-bbbaa5acea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-760423807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea6561b-07ac-4224-9a2e-447619db8ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a351fa4f7f84928b5602f5f256e9d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:03Z,use_quota=True,user_id='5a48de5792df46aaa3c964c980665a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f287542-70a5-4d68-b099-1b572daab340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f287542-70a5-4d68-b099-1b572daab340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcdc6fa-f1b1-4a71-9ec5-dcd93edd7c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcdc6fa-f1b1-4a71-9ec5-dcd93edd7c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea6561b-07ac-4224-9a2e-447619db8ad1', 'volume_name': 'volume-5ea6561b-07ac-4224-9a2e-447619db8ad1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f291ab-6a7f-4539-ae1e-8de8eb94aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f291ab-6a7f-4539-ae1e-8de8eb94aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b435a1c-e880-4c17-be04-c05b3288c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Volume 5ea6561b-07ac-4224-9a2e-447619db8ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea6561b-07ac-4224-9a2e-447619db8ad1', 'volume_size': 1} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-760423807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea6561b-07ac-4224-9a2e-447619db8ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a351fa4f7f84928b5602f5f256e9d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:03Z,use_quota=True,user_id='5a48de5792df46aaa3c964c980665a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Creating volume 5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:39:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:03 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 1073741824 Jul 06 15:39:03 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:04 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 1073741824" returned: 0 in 1.119s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:04 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:04 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:05 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 1.072s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b435a1c-e880-4c17-be04-c05b3288c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea6561b-07ac-4224-9a2e-447619db8ad1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049542c4-062d-4771-96a9-e9e397566ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:05 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Volume volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 (5ea6561b-07ac-4224-9a2e-447619db8ad1): created successfully Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049542c4-062d-4771-96a9-e9e397566ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Flow 'volume_create_manager' (8f1c4301-3d72-4b9c-9168-1d68f5b0fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7dbc9866-f70f-4681-b240-41051870773e tempest-VolumesDeleteCascade-359499570 None] Created volume successfully. Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:07 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:39:07 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Creating offline snapshot f90900b0-2fc8-4bba-979d-a6f776a847f4 of volume 5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:39:07 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb89c24-2084-448a-ae99-fa649b2a31b4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:07 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:07 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:08 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 1.545s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:08 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 2.005s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:39:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:39:08 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 1G Jul 06 15:39:08 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 1G" returned: 0 in 1.371s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:10 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:10 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 Jul 06 15:39:10 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:11 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4" returned: 0 in 1.403s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:11 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 is being set with open permissions: ugo+rw Jul 06 15:39:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:11 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 Jul 06 15:39:11 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:12 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4" returned: 0 in 1.328s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:13 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:INSERT=23,cinder:UPDATE=87,cinder:SELECT=69,cinder:DELETE=8 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:39:13 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=74,cinder:INSERT=27,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:39:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:13 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info Jul 06 15:39:13 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:14 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info" returned: 0 in 1.256s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:14 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info is being set with open permissions: ugo+rw Jul 06 15:39:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:14 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info Jul 06 15:39:14 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:15 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.info" returned: 0 in 0.976s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.341s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cffa38c7-3f3e-49d8-975d-b8faafc2fa3c tempest-VolumesDeleteCascade-359499570 None] Create snapshot completed successfully Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Flow 'volume_create_manager' (698eef1d-737f-4290-ae87-2839b5d75eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204ff60e-6e8c-42b1-a97f-08e58e39823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204ff60e-6e8c-42b1-a97f-08e58e39823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1840666248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396a49f6-59d0-4cbf-8b43-16809441fc41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a351fa4f7f84928b5602f5f256e9d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f90900b0-2fc8-4bba-979d-a6f776a847f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:16Z,use_quota=True,user_id='5a48de5792df46aaa3c964c980665a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44483895-40e2-4241-9eff-900b9acf9fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44483895-40e2-4241-9eff-900b9acf9fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5672e2-b943-450a-92b3-036fd0576f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5672e2-b943-450a-92b3-036fd0576f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '396a49f6-59d0-4cbf-8b43-16809441fc41', 'volume_name': 'volume-396a49f6-59d0-4cbf-8b43-16809441fc41', 'volume_size': 1, 'snapshot_id': 'f90900b0-2fc8-4bba-979d-a6f776a847f4'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f987f50-b5ea-4ef0-a24b-938ac6da371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f987f50-b5ea-4ef0-a24b-938ac6da371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae353bc7-48bf-4c59-9b71-1f96cf8e459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:16 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Volume 396a49f6-59d0-4cbf-8b43-16809441fc41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-396a49f6-59d0-4cbf-8b43-16809441fc41', 'volume_size': 1, 'snapshot_id': 'f90900b0-2fc8-4bba-979d-a6f776a847f4'} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-f90900b0-2fc8-4bba-979d-a6f776a847f4-396a49f6-59d0-4cbf-8b43-16809441fc41" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-f90900b0-2fc8-4bba-979d-a6f776a847f4-396a49f6-59d0-4cbf-8b43-16809441fc41" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Creating volume 396a49f6-59d0-4cbf-8b43-16809441fc41 from snapshot f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-396a49f6-59d0-4cbf-8b43-16809441fc41" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-396a49f6-59d0-4cbf-8b43-16809441fc41" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] snapshot: f90900b0-2fc8-4bba-979d-a6f776a847f4, volume: 396a49f6-59d0-4cbf-8b43-16809441fc41, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d31ac36-d481-4da1-bec3-239a74dedd0d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:16 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 Jul 06 15:39:16 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:17 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4" returned: 0 in 1.153s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea6561b-07ac-4224-9a2e-447619db8ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:39:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:39:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:39:18 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a84fd-0da4-48c9-afac-a61b2890cdb0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:18 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:18 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:19 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 1.266s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:19 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:39:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:19 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 Jul 06 15:39:19 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Flow 'volume_create_manager' (f477c026-1048-40af-890b-9d7fd662b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661d8577-c2d9-4a10-9ddd-d38adc7fde98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661d8577-c2d9-4a10-9ddd-d38adc7fde98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1538539925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fffb1d-cbe5-4864-acb7-57bd87cd444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9974f499904822af72c1153972c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:24Z,use_quota=True,user_id='99f1dbc2380d4919a3d890d27eb5a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b90927d1-d19c-48af-921d-68f6a58b1f5a),volume_type_id=b90927d1-d19c-48af-921d-68f6a58b1f5a)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f42fdb-6a5a-4339-9340-b4dd8abaf118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f42fdb-6a5a-4339-9340-b4dd8abaf118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b3b31c-2fcb-41d0-b7dd-7aa97566b1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b3b31c-2fcb-41d0-b7dd-7aa97566b1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45fffb1d-cbe5-4864-acb7-57bd87cd444e', 'volume_name': 'volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea06f7ae-aa86-4bb1-9806-59026b6b4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea06f7ae-aa86-4bb1-9806-59026b6b4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4425909-0cb2-4d0c-89f5-4999936e065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume 45fffb1d-cbe5-4864-acb7-57bd87cd444e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e', 'volume_size': 1} Jul 06 15:39:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Flow 'volume_create_manager' (bd8c96a0-3f8c-4fe3-897a-26ec44ce34fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6470e970-300e-429c-8917-b0fa4ba621eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6470e970-300e-429c-8917-b0fa4ba621eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1625742213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb60566-bc76-403c-a4ce-13c09f82aa8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9974f499904822af72c1153972c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:25Z,use_quota=True,user_id='99f1dbc2380d4919a3d890d27eb5a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e03345c-f8b2-4511-9043-8da80ee156a0),volume_type_id=9e03345c-f8b2-4511-9043-8da80ee156a0)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056b7395-149a-496f-9efd-4965f04a3b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056b7395-149a-496f-9efd-4965f04a3b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456c7ba2-ad08-424c-8fb2-857070a31b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456c7ba2-ad08-424c-8fb2-857070a31b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb60566-bc76-403c-a4ce-13c09f82aa8c', 'volume_name': 'volume-efb60566-bc76-403c-a4ce-13c09f82aa8c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb61780f-ea9b-47eb-8248-84504169d529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb61780f-ea9b-47eb-8248-84504169d529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54c4cf8-8a24-4947-aa11-2cd4778d86c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume efb60566-bc76-403c-a4ce-13c09f82aa8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb60566-bc76-403c-a4ce-13c09f82aa8c', 'volume_size': 1} Jul 06 15:39:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:26 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41" returned: 0 in 7.532s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef74784d-1d23-4230-afdd-cb4a6db8820c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Flow 'volume_create_manager' (fe6651e3-c7f1-4b2d-ac91-7d00664557ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d4028a-7079-43be-ad4b-0525396ae827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d4028a-7079-43be-ad4b-0525396ae827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-169051429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9575007-65e3-4ef5-8aa9-0fc4c0f01ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9974f499904822af72c1153972c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:27Z,use_quota=True,user_id='99f1dbc2380d4919a3d890d27eb5a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd524fe-c7a4-4bd1-a479-c74c53e945cf),volume_type_id=6dd524fe-c7a4-4bd1-a479-c74c53e945cf)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340a64aa-44a5-4333-ad1e-0eb45d5444c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340a64aa-44a5-4333-ad1e-0eb45d5444c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff0ba23-205c-4630-bcdf-255ea71e568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:26 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:39:26 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:26 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff0ba23-205c-4630-bcdf-255ea71e568f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9575007-65e3-4ef5-8aa9-0fc4c0f01ace', 'volume_name': 'volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace', 'volume_size': 1, 'image_id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1151022918', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f9974f499904822af72c1153972c916', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'created_at': datetime.datetime(2026, 7, 6, 13, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 39, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281/file', 'properties': {}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b201eddc-95a0-4a39-bd3e-7252e0615142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b201eddc-95a0-4a39-bd3e-7252e0615142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47f6008-659d-405e-af2e-fd0ba7e6cb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume c9575007-65e3-4ef5-8aa9-0fc4c0f01ace: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace', 'volume_size': 1, 'image_id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1151022918', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f9974f499904822af72c1153972c916', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'created_at': datetime.datetime(2026, 7, 6, 13, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 39, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281/file', 'properties': {}}, 'image_service': } Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Trying to clone c9575007-65e3-4ef5-8aa9-0fc4c0f01ace from image 6cadfa9f-6359-418c-a3b1-5c5d789c9281 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:39:27 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 0.993s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:39:27 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Converted 1024.00 MB image at 135.93 MB/s Jul 06 15:39:27 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 is being set with open permissions: ugo+rw Jul 06 15:39:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:27 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 Jul 06 15:39:27 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:28 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41" returned: 0 in 0.636s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-396a49f6-59d0-4cbf-8b43-16809441fc41" released by "_copy_volume_from_snapshot" :: held 11.711s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-f90900b0-2fc8-4bba-979d-a6f776a847f4-396a49f6-59d0-4cbf-8b43-16809441fc41" released by "_create_volume_from_snapshot" :: held 11.755s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.777s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.961s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1538539925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fffb1d-cbe5-4864-acb7-57bd87cd444e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9974f499904822af72c1153972c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:24Z,use_quota=True,user_id='99f1dbc2380d4919a3d890d27eb5a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b90927d1-d19c-48af-921d-68f6a58b1f5a),volume_type_id=b90927d1-d19c-48af-921d-68f6a58b1f5a)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Creating volume 45fffb1d-cbe5-4864-acb7-57bd87cd444e {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:28 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:28 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e 1073741824 Jul 06 15:39:28 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae353bc7-48bf-4c59-9b71-1f96cf8e459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396a49f6-59d0-4cbf-8b43-16809441fc41', 'volume_size': 1, 'snapshot_id': 'f90900b0-2fc8-4bba-979d-a6f776a847f4'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99657e19-5688-4343-9dd6-4129b869ccfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Volume volume-396a49f6-59d0-4cbf-8b43-16809441fc41 (396a49f6-59d0-4cbf-8b43-16809441fc41): created successfully Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99657e19-5688-4343-9dd6-4129b869ccfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Flow 'volume_create_manager' (698eef1d-737f-4290-ae87-2839b5d75eee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d6978af4-88a2-4acd-a141-6805b345a472 tempest-VolumesDeleteCascade-359499570 None] Created volume successfully. Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-5ea6561b-07ac-4224-9a2e-447619db8ad1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-5ea6561b-07ac-4224-9a2e-447619db8ad1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Performing cascade delete. {{(pid=86191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-f90900b0-2fc8-4bba-979d-a6f776a847f4-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-f90900b0-2fc8-4bba-979d-a6f776a847f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-5ea6561b-07ac-4224-9a2e-447619db8ad1" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-5ea6561b-07ac-4224-9a2e-447619db8ad1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-f90900b0-2fc8-4bba-979d-a6f776a847f4" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-f90900b0-2fc8-4bba-979d-a6f776a847f4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:29 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Deleting offline snapshot f90900b0-2fc8-4bba-979d-a6f776a847f4 of volume 5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] snapshot_file for this snap is: volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e 1073741824" returned: 0 in 1.033s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ce8236-e9f4-4cd4-934e-f95e99290f85]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:29 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e Jul 06 15:39:29 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:29 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 Jul 06 15:39:29 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:30 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e" returned: 0 in 0.629s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.288s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1625742213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb60566-bc76-403c-a4ce-13c09f82aa8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9974f499904822af72c1153972c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:25Z,use_quota=True,user_id='99f1dbc2380d4919a3d890d27eb5a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e03345c-f8b2-4511-9043-8da80ee156a0),volume_type_id=9e03345c-f8b2-4511-9043-8da80ee156a0)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Creating volume efb60566-bc76-403c-a4ce-13c09f82aa8c {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:30 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4425909-0cb2-4d0c-89f5-4999936e065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c 1073741824 Jul 06 15:39:30 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d8b149-6793-41f4-b992-34562e4e6191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e (45fffb1d-cbe5-4864-acb7-57bd87cd444e): created successfully Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d8b149-6793-41f4-b992-34562e4e6191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Flow 'volume_create_manager' (f477c026-1048-40af-890b-9d7fd662b717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ffa26b7c-3e4d-4399-8d8d-45a921c5c612 tempest-TestInstancesWithCinderVolumes-867529212 None] Created volume successfully. Jul 06 15:39:30 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4" returned: 0 in 0.800s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea6561b-07ac-4224-9a2e-447619db8ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee24149-7245-4271-a9f3-a9279f4ecf7d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:30 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:30 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD, size 20.69 MB, duration 3.61 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:39:30 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Image download 20.69 MB at 5.73 MB/s Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66a47e-30b1-4423-a889-b8bd4951f69a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD Jul 06 15:39:31 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:31 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 0.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 Jul 06 15:39:31 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:31 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c 1073741824" returned: 0 in 0.966s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c Jul 06 15:39:31 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:31 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Temporary image 6cadfa9f-6359-418c-a3b1-5c5d789c9281 is fetched for user 99f1dbc2380d4919a3d890d27eb5a3ba. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b363de-4beb-4ce1-a306-e067858c9830]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD Jul 06 15:39:31 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:31 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c" returned: 0 in 0.666s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.410s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:31 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4" returned: 0 in 0.768s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd9a18f-2680-4814-b279-cc6bdc6de591]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54c4cf8-8a24-4947-aa11-2cd4778d86c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb60566-bc76-403c-a4ce-13c09f82aa8c', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:31 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4 Jul 06 15:39:31 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5fc44d-7569-490f-8d5d-7433bb859c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume volume-efb60566-bc76-403c-a4ce-13c09f82aa8c (efb60566-bc76-403c-a4ce-13c09f82aa8c): created successfully Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5fc44d-7569-490f-8d5d-7433bb859c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Flow 'volume_create_manager' (bd8c96a0-3f8c-4fe3-897a-26ec44ce34fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-814643a7-8d1f-432c-adb3-fc9b2fb360d7 tempest-TestInstancesWithCinderVolumes-867529212 None] Created volume successfully. Jul 06 15:39:32 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a Jul 06 15:39:32 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:32 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:32 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1.f90900b0-2fc8-4bba-979d-a6f776a847f4" returned: 0 in 0.656s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-f90900b0-2fc8-4bba-979d-a6f776a847f4" released by "_delete_snapshot" :: held 3.096s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-5ea6561b-07ac-4224-9a2e-447619db8ad1" released by "delete_snapshot" :: held 3.123s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Created reservations ['0715fd6b-0779-4c4a-a5c5-23a3d282a2e9', '82529332-7c47-41ac-80b3-2f90a2609fbc', 'bc035bea-bb0d-45ea-b159-2f6fd6f7077e', '296e7eb2-887e-4259-a843-92764c7e7ceb'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:32 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" returned: 0 in 0.797s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.237s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-169051429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9575007-65e3-4ef5-8aa9-0fc4c0f01ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9974f499904822af72c1153972c916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:27Z,use_quota=True,user_id='99f1dbc2380d4919a3d890d27eb5a3ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd524fe-c7a4-4bd1-a479-c74c53e945cf),volume_type_id=6dd524fe-c7a4-4bd1-a479-c74c53e945cf)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Creating volume c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:32 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Delete snapshot completed successfully. Jul 06 15:39:32 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace 1073741824 Jul 06 15:39:32 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-f90900b0-2fc8-4bba-979d-a6f776a847f4-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Snapshots deleted, issuing volume delete {{(pid=86191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-5ea6561b-07ac-4224-9a2e-447619db8ad1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-5ea6561b-07ac-4224-9a2e-447619db8ad1" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16594ede-1285-4812-9f03-adf56a284b65', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a15d910-c559-4df2-acef-b9da8c79183e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-71a30d55-e216-4c69-8f61-3d87217113bf req-f10d34ba-2ed2-408a-acea-15b7132bcfcf tempest-TestServerVolumeAttachmentScenario-787770676 None] attachment_update completed successfully. Jul 06 15:39:32 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:32 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:33 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace 1073741824" returned: 0 in 0.925s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:33 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:33 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1 Jul 06 15:39:33 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:33 devstack sudo[99405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:39:33 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:34 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5ea6561b-07ac-4224-9a2e-447619db8ad1" returned: 0 in 0.747s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-5ea6561b-07ac-4224-9a2e-447619db8ad1" released by "delete_volume" :: held 1.651s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Created reservations ['bb68ac2e-4cf2-4fff-bca4-bb56d22b7f90', '38732ec1-edcc-43dc-b09c-d75df184f0ea', '5e7f065e-fdb5-4a84-be00-5798c1d06cde', '1d900c61-593c-49ce-a5e9-631cc934f3d4'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:34 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 0 in 0.805s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Attempting download of 6cadfa9f-6359-418c-a3b1-5c5d789c9281 ((None, [{'url': 'file:///opt/stack/data/glance/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'metadata': {}}])) to volume c9575007-65e3-4ef5-8aa9-0fc4c0f01ace. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:34 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:39:34 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5e1fc-6aa9-44d6-acf7-7b63cd9ae288]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:34 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136 Jul 06 15:39:34 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-396a49f6-59d0-4cbf-8b43-16809441fc41-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-396a49f6-59d0-4cbf-8b43-16809441fc41-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "cinder-quobyte-396a49f6-59d0-4cbf-8b43-16809441fc41" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-396a49f6-59d0-4cbf-8b43-16809441fc41" acquired by "delete_volume" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ce158-0739-468f-9042-bb0fac648f6b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:35 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 Jul 06 15:39:35 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:35 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.845s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Deleted volume successfully. Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-014b8f65-b33e-46b7-999c-a7f0375c4a7a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-5ea6561b-07ac-4224-9a2e-447619db8ad1-delete_volume" released by "delete_volume" :: held 6.116s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:35 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136" returned: 0 in 1.083s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:35 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136 Jul 06 15:39:35 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41" returned: 0 in 0.805s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41 Jul 06 15:39:36 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136" returned: 1 in 0.791s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cadfa9f-6359-418c-a3b1-5c5d789c9281_fjeew136' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1748843-be42-4e62-9847-42513ef41e54]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-396a49f6-59d0-4cbf-8b43-16809441fc41" returned: 0 in 0.653s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:36 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD Jul 06 15:39:36 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-quobyte-396a49f6-59d0-4cbf-8b43-16809441fc41" released by "delete_volume" :: held 1.515s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Created reservations ['1f18d2c6-e20c-4393-b53a-9053093a6cb1', '5b906f5c-ecd6-4a93-8113-ec02adec1876', '204ac08e-1d3e-4637-90c8-482dfbe80823', 'f8d0a998-b85c-4c8d-8fb0-17181c940e1b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:36 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:39:36 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:37 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:37 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] 6cadfa9f-6359-418c-a3b1-5c5d789c9281 was qcow2, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:39:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:37 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:39:37 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:37 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.781s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Deleted volume successfully. Jul 06 15:39:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-79a7a6e9-9ecb-4d41-b979-8675cc091d4a tempest-VolumesDeleteCascade-359499570 None] Lock "cinder-396a49f6-59d0-4cbf-8b43-16809441fc41-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:39 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 0 in 2.531s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:39 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6cadfa9f-6359-418c-a3b1-5c5d789c9281_12if_73qdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:39:39 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Converted 112.00 MB image at 44.24 MB/s Jul 06 15:39:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:39 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace 1G Jul 06 15:39:39 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:40 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace 1G" returned: 0 in 0.726s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c652df7f-14ad-41db-866c-512a1ddb46d4]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:40 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:39:40 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:41 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 0 in 0.781s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:41 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:39:41 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:42 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 1 in 0.914s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Downloaded image 6cadfa9f-6359-418c-a3b1-5c5d789c9281 ((None, [{'url': 'file:///opt/stack/data/glance/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'metadata': {}}])) to volume c9575007-65e3-4ef5-8aa9-0fc4c0f01ace successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Temporary image 6cadfa9f-6359-418c-a3b1-5c5d789c9281 for user 99f1dbc2380d4919a3d890d27eb5a3ba is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Marking volume c9575007-65e3-4ef5-8aa9-0fc4c0f01ace as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Copying metadata from image 6cadfa9f-6359-418c-a3b1-5c5d789c9281 to c9575007-65e3-4ef5-8aa9-0fc4c0f01ace. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Creating volume glance metadata for volume c9575007-65e3-4ef5-8aa9-0fc4c0f01ace backed by image 6cadfa9f-6359-418c-a3b1-5c5d789c9281 with: {'image_id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'image_name': 'tempest-scenario-img--1151022918', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47f6008-659d-405e-af2e-fd0ba7e6cb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace', 'volume_size': 1, 'image_id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1151022918', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f9974f499904822af72c1153972c916', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6cadfa9f-6359-418c-a3b1-5c5d789c9281', 'created_at': datetime.datetime(2026, 7, 6, 13, 39, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 39, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6cadfa9f-6359-418c-a3b1-5c5d789c9281/file', 'properties': {}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f235a070-5570-48a8-9001-a7972e08196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Volume volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace (c9575007-65e3-4ef5-8aa9-0fc4c0f01ace): created successfully Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f235a070-5570-48a8-9001-a7972e08196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Flow 'volume_create_manager' (fe6651e3-c7f1-4b2d-ac91-7d00664557ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-87c26c51-8286-46b2-a9ab-61d92bb7d5b5 tempest-TestInstancesWithCinderVolumes-867529212 None] Created volume successfully. Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Flow 'volume_create_manager' (9cbd9740-7ad3-4b12-990e-01b312c6338d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92880048-cd47-44c4-a627-a46664e0a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92880048-cd47-44c4-a627-a46664e0a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1985808448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c348edf-bf22-4539-aac8-01f9d50e6256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c712ac1f0342129dbdb1954e012ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:43Z,use_quota=True,user_id='85434e02f18e4bcebb9f9b5230c3c782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b519b11-c025-4936-81b4-91fea0ddac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b519b11-c025-4936-81b4-91fea0ddac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d047b303-312c-4cb5-ba32-e3c6a1b44af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d047b303-312c-4cb5-ba32-e3c6a1b44af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c348edf-bf22-4539-aac8-01f9d50e6256', 'volume_name': 'volume-6c348edf-bf22-4539-aac8-01f9d50e6256', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072764e6-37f4-4872-96b2-d82d4d17a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072764e6-37f4-4872-96b2-d82d4d17a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c05cff-bc6a-4046-b109-0523b956fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Volume 6c348edf-bf22-4539-aac8-01f9d50e6256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c348edf-bf22-4539-aac8-01f9d50e6256', 'volume_size': 1} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1985808448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c348edf-bf22-4539-aac8-01f9d50e6256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c712ac1f0342129dbdb1954e012ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:43Z,use_quota=True,user_id='85434e02f18e4bcebb9f9b5230c3c782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Creating volume 6c348edf-bf22-4539-aac8-01f9d50e6256 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:42 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:39:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:42 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 1073741824 Jul 06 15:39:42 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:43 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 1073741824" returned: 0 in 1.061s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:43 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 Jul 06 15:39:43 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:44 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256" returned: 0 in 0.751s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.313s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c05cff-bc6a-4046-b109-0523b956fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c348edf-bf22-4539-aac8-01f9d50e6256', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174a8377-ab5a-47eb-8e16-324661ce4465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[00096207-5e36-4a44-b281-5feef31e9c87]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Volume volume-6c348edf-bf22-4539-aac8-01f9d50e6256 (6c348edf-bf22-4539-aac8-01f9d50e6256): created successfully Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174a8377-ab5a-47eb-8e16-324661ce4465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Flow 'volume_create_manager' (9cbd9740-7ad3-4b12-990e-01b312c6338d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-48efea45-0789-4033-8db3-0f9bac7b48fe tempest-VolumesTransfersV357Test-1896323022 None] Created volume successfully. Jul 06 15:39:45 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 Jul 06 15:39:45 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-6eccbfe4-1269-4b91-9e2a-35d4a4502cc9 req-6008af28-ffb6-4630-a037-5c8699808de0 tempest-TestShelveInstance-1102387538 None] Terminate volume connection completed successfully. Jul 06 15:39:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-6eccbfe4-1269-4b91-9e2a-35d4a4502cc9 req-6008af28-ffb6-4630-a037-5c8699808de0 tempest-TestShelveInstance-1102387538 None] Deleting attachment 5047830c-111a-401c-abf1-9fbf695e86e2. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:39:45 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9" returned: 0 in 1.085s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.155s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-6b612660-dd61-4f64-b02f-4215402a80b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b553e7c-f93a-4f4b-8c81-056c3834b285', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:45 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-a07b9435-21b7-46a5-9ee5-dca5c2d10ed3 req-53f7f6fa-ddaa-40b2-b3cb-8a98d1ee3f4d tempest-TestServerVolumeAttachmentScenario-787770676 None] attachment_update completed successfully. Jul 06 15:39:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e6616d7b-a22e-4163-a289-b47a5911c3ae tempest-VolumesTransfersV357Test-369080019 None] Transfer volume completed successfully. Jul 06 15:39:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Acquiring lock "cinder-6c348edf-bf22-4539-aac8-01f9d50e6256-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-6c348edf-bf22-4539-aac8-01f9d50e6256-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Acquiring lock "cinder-quobyte-6c348edf-bf22-4539-aac8-01f9d50e6256" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-quobyte-6c348edf-bf22-4539-aac8-01f9d50e6256" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eba81f-1ac7-4ffb-b04f-6665159087e3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:48 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 Jul 06 15:39:48 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:48 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256" returned: 0 in 0.779s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:48 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256 Jul 06 15:39:48 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:49 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6c348edf-bf22-4539-aac8-01f9d50e6256" returned: 0 in 0.734s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-quobyte-6c348edf-bf22-4539-aac8-01f9d50e6256" released by "delete_volume" :: held 1.559s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Created reservations ['7fbd66a8-8c72-4260-83d0-c10d5fdc2c7d', '9ecdf11b-69bb-4678-8309-b8bd6140ed89', '582a3e1b-370a-425b-ab2a-1cd23fb5586e', 'c5d202fc-ff70-4e60-8111-ac589f724ad7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:49 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:39:49 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:50 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:50 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Deleted volume successfully. Jul 06 15:39:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3f5a2ca0-4f14-4868-ac76-fdecc215a4af tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-6c348edf-bf22-4539-aac8-01f9d50e6256-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:50 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:39:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Flow 'volume_create_manager' (8f11b69a-1596-4e2f-83a8-6cb72b65cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94af8430-90bd-43d3-9693-b31e5a8d4340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94af8430-90bd-43d3-9693-b31e5a8d4340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-14118282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3389cc-f4bb-4758-a800-2b5422e79945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c712ac1f0342129dbdb1954e012ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:51Z,use_quota=True,user_id='85434e02f18e4bcebb9f9b5230c3c782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8aca28-5b7d-4fe2-a29c-aed35d9401e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8aca28-5b7d-4fe2-a29c-aed35d9401e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b972ffb-804e-435c-aaba-6bbd58f7c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b972ffb-804e-435c-aaba-6bbd58f7c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3389cc-f4bb-4758-a800-2b5422e79945', 'volume_name': 'volume-0d3389cc-f4bb-4758-a800-2b5422e79945', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b88c41-3661-41d1-b760-89645d0d55ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b88c41-3661-41d1-b760-89645d0d55ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d4af34-d216-431c-8418-01a8280e8fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Volume 0d3389cc-f4bb-4758-a800-2b5422e79945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3389cc-f4bb-4758-a800-2b5422e79945', 'volume_size': 1} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-14118282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3389cc-f4bb-4758-a800-2b5422e79945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17c712ac1f0342129dbdb1954e012ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:39:51Z,use_quota=True,user_id='85434e02f18e4bcebb9f9b5230c3c782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Creating volume 0d3389cc-f4bb-4758-a800-2b5422e79945 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:39:51 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:51 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 1073741824 Jul 06 15:39:51 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:52 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 1073741824" returned: 0 in 0.964s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:52 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 Jul 06 15:39:52 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:52 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.237s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d4af34-d216-431c-8418-01a8280e8fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3389cc-f4bb-4758-a800-2b5422e79945', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c31f9ef-0768-4801-90da-c670568602bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:39:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Volume volume-0d3389cc-f4bb-4758-a800-2b5422e79945 (0d3389cc-f4bb-4758-a800-2b5422e79945): created successfully Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c31f9ef-0768-4801-90da-c670568602bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Flow 'volume_create_manager' (8f11b69a-1596-4e2f-83a8-6cb72b65cbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a10574-b986-4433-a064-d3cfe6291056]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3867f968-6cd8-4131-8935-48ac898c4aff tempest-VolumesTransfersV357Test-1896323022 None] Created volume successfully. Jul 06 15:39:52 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:39:52 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:53 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 0 in 0.744s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:53 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:39:53 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:54 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 1 in 0.738s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.539s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.182s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d2e4188-d8ef-4a2b-b0b1-e49604538539', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd90a69-366b-415d-8d3b-2955b64d9134]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-bfe42df4-5079-4f0e-8eac-74685236a6c3 tempest-TestInstancesWithCinderVolumes-867529212 None] attachment_update completed successfully. Jul 06 15:39:54 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:39:54 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-fa084c1a-2845-4825-8abd-4b2d5d7ff2df req-8bf9603e-b440-48f7-aada-19d473f4f1be tempest-TestServerVolumeAttachmentScenario-787770676 None] Terminate volume connection completed successfully. Jul 06 15:39:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-fa084c1a-2845-4825-8abd-4b2d5d7ff2df req-8bf9603e-b440-48f7-aada-19d473f4f1be tempest-TestServerVolumeAttachmentScenario-787770676 None] Deleting attachment 9b553e7c-f93a-4f4b-8c81-056c3834b285. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:39:55 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 0.881s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:55 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:39:55 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Acquiring lock "cinder-0d3389cc-f4bb-4758-a800-2b5422e79945-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-0d3389cc-f4bb-4758-a800-2b5422e79945-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Acquiring lock "cinder-quobyte-0d3389cc-f4bb-4758-a800-2b5422e79945" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-quobyte-0d3389cc-f4bb-4758-a800-2b5422e79945" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4ff243-5006-406c-90da-94a30d2bbc00]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:39:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:55 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 Jul 06 15:39:55 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:56 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 1 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:39:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.705s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f74906dc-295f-49af-96f5-c6e3be3ff183', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:39:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-4a07efe5-d74e-4860-9861-ebafae12e4c9 req-4a97710d-14ec-4683-aba9-1770a53efb65 tempest-TestShelveInstance-1102387538 None] attachment_update completed successfully. Jul 06 15:39:56 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945" returned: 0 in 0.833s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:56 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945 Jul 06 15:39:56 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:57 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-0d3389cc-f4bb-4758-a800-2b5422e79945" returned: 0 in 0.690s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-quobyte-0d3389cc-f4bb-4758-a800-2b5422e79945" released by "delete_volume" :: held 1.572s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Created reservations ['34201716-f138-4ced-9787-fd6a23b15a1f', 'f6e0de6c-8d6f-4175-8545-2f779c031fd7', '34837223-848d-4fe7-92aa-67a632d2f28f', '53a064f5-172b-409f-bbbc-62d32f6a079c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:39:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:39:57 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:39:57 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:39:58 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 06 15:39:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.786s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:39:58 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:39:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Deleted volume successfully. Jul 06 15:39:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-05cd8e09-7bbc-4d49-9c4c-84fd7b3b3148 tempest-VolumesTransfersV357Test-1598458938 None] Lock "cinder-0d3389cc-f4bb-4758-a800-2b5422e79945-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:39:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-22af7240-8897-449b-9c4a-a224526d5acc req-e27ff7d0-6bf1-49ad-9653-4781f911fcb5 tempest-TestServerVolumeAttachmentScenario-787770676 None] Terminate volume connection completed successfully. Jul 06 15:39:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-22af7240-8897-449b-9c4a-a224526d5acc req-e27ff7d0-6bf1-49ad-9653-4781f911fcb5 tempest-TestServerVolumeAttachmentScenario-787770676 None] Deleting attachment 16594ede-1285-4812-9f03-adf56a284b65. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:40:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-ce556fb7-017f-4ca3-a490-1af7f58d9581 tempest-TestInstancesWithCinderVolumes-867529212 None] Terminate volume connection completed successfully. Jul 06 15:40:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-ef02442f-7be0-46f9-bdf8-f34f2af62721 req-ce556fb7-017f-4ca3-a490-1af7f58d9581 tempest-TestInstancesWithCinderVolumes-867529212 None] Deleting attachment 3d2e4188-d8ef-4a2b-b0b1-e49604538539. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:40:05 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Flow 'volume_create_manager' (b728c139-0d2a-4ca9-b0f6-f279742594ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15cbb56-d10d-49fb-826c-6c389df9ab7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15cbb56-d10d-49fb-826c-6c389df9ab7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-246069302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c6ab41-af9a-4ba6-866c-e9cd96fbe966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab64dbe392774ef499ebc7c1f2d96a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:06Z,use_quota=True,user_id='127c0a27a8ed43f3b14c166e55412b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788781e1-aa99-43ef-9501-878d2dd96205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (788781e1-aa99-43ef-9501-878d2dd96205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3f52e2-2d7c-4604-99b5-db1277111f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f3f52e2-2d7c-4604-99b5-db1277111f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c6ab41-af9a-4ba6-866c-e9cd96fbe966', 'volume_name': 'volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966', 'volume_size': 2}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc077e4-3832-47d0-9442-2a4c99384d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc077e4-3832-47d0-9442-2a4c99384d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab724cc5-f111-47e8-801e-053f36f29e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Volume 81c6ab41-af9a-4ba6-866c-e9cd96fbe966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966', 'volume_size': 2} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-246069302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c6ab41-af9a-4ba6-866c-e9cd96fbe966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab64dbe392774ef499ebc7c1f2d96a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:06Z,use_quota=True,user_id='127c0a27a8ed43f3b14c166e55412b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Creating volume 81c6ab41-af9a-4ba6-866c-e9cd96fbe966 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:06 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 2147483648 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 2147483648 Jul 06 15:40:06 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:06 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:06 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:07 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 2147483648" returned: 0 in 1.160s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:07 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 Jul 06 15:40:07 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:08 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.218s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:40:08 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966" returned: 0 in 1.059s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab724cc5-f111-47e8-801e-053f36f29e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966', 'volume_size': 2}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e586f14a-86d0-4cd5-a744-85ad039d8dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Volume volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 (81c6ab41-af9a-4ba6-866c-e9cd96fbe966): created successfully Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e586f14a-86d0-4cd5-a744-85ad039d8dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Flow 'volume_create_manager' (b728c139-0d2a-4ca9-b0f6-f279742594ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7bf9dbb8-6cd5-4349-b1c4-575f91d78352 tempest-VolumesCloneNegativeTest-49089923 None] Created volume successfully. Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "cinder-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "cinder-quobyte-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-quobyte-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5b8bc9-a3ce-425a-b927-1f922e893d57]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:09 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:40:09 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Acquiring lock "cinder-81c6ab41-af9a-4ba6-866c-e9cd96fbe966-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Lock "cinder-81c6ab41-af9a-4ba6-866c-e9cd96fbe966-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Acquiring lock "cinder-quobyte-81c6ab41-af9a-4ba6-866c-e9cd96fbe966" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Lock "cinder-quobyte-81c6ab41-af9a-4ba6-866c-e9cd96fbe966" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd82719-d2ac-493a-a5f9-dfd6278d9c0d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:09 devstack sudo[100208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 Jul 06 15:40:09 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:09 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 0 in 0.855s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:09 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:40:09 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:10 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966" returned: 0 in 0.872s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:10 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966 Jul 06 15:40:10 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:10 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 1 in 0.994s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:10 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace Jul 06 15:40:10 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:11 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-81c6ab41-af9a-4ba6-866c-e9cd96fbe966" returned: 0 in 0.867s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Lock "cinder-quobyte-81c6ab41-af9a-4ba6-866c-e9cd96fbe966" released by "delete_volume" :: held 1.803s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Created reservations ['93db8a31-73b9-4a97-8184-77a811af51c8', 'a7932f82-5099-46cc-9edd-29f607faaf9a', '6c952829-31ac-40e6-b5e3-f053cfd09ee1', 'a0c33c91-7615-45e4-a9a3-57248fccdb8b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:11 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:11 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:11 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" returned: 0 in 0.911s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-quobyte-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace" released by "delete_volume" :: held 2.846s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:11 devstack cinder-volume[86191]: WARNING cinder.quota [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1028789941-1670896331 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1028789941-1670896331, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:11 devstack cinder-volume[86191]: WARNING cinder.quota [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1028789941-1670896331 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1028789941-1670896331, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Created reservations ['5c1f0099-9e37-4971-9e52-3e2c8b27e52a', 'b037174c-6451-458a-ae2b-1dbcacafac4f', '116194bc-2359-4e9e-9096-8757a6ee97c4', '49763606-87fd-4543-9648-fc3eae15be05'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "cinder-6b612660-dd61-4f64-b02f-4215402a80b9-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-6b612660-dd61-4f64-b02f-4215402a80b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "cinder-quobyte-6b612660-dd61-4f64-b02f-4215402a80b9" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-quobyte-6b612660-dd61-4f64-b02f-4215402a80b9" acquired by "delete_volume" :: waited 0.060s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:12 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:12 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[038b7993-df23-4c0e-9f1c-f5b0aaca1046]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "cinder-efb60566-bc76-403c-a4ce-13c09f82aa8c-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-efb60566-bc76-403c-a4ce-13c09f82aa8c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:12 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 Jul 06 15:40:12 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "cinder-quobyte-efb60566-bc76-403c-a4ce-13c09f82aa8c" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-quobyte-efb60566-bc76-403c-a4ce-13c09f82aa8c" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25f4179-3b51-413b-b235-cf14150c1388]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:12 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c Jul 06 15:40:12 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:13 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.741s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Deleted volume successfully. Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=94,cinder:UPDATE=89,cinder:INSERT=20,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e8ba8a47-8c7c-443f-b581-a46d9327adba tempest-VolumesCloneNegativeTest-49089923 None] Lock "cinder-81c6ab41-af9a-4ba6-866c-e9cd96fbe966-delete_volume" released by "delete_volume" :: held 3.890s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:13 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.497s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Deleted volume successfully. Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9040ceaa-59d1-4915-a8c2-63a7ef051062 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-c9575007-65e3-4ef5-8aa9-0fc4c0f01ace-delete_volume" released by "delete_volume" :: held 4.719s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:13 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9" returned: 0 in 1.866s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:14 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9 Jul 06 15:40:14 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:14 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c" returned: 0 in 1.476s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:14 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c Jul 06 15:40:14 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:14 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6b612660-dd61-4f64-b02f-4215402a80b9" returned: 0 in 0.924s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-quobyte-6b612660-dd61-4f64-b02f-4215402a80b9" released by "delete_volume" :: held 2.904s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=77,cinder:SELECT=78,cinder:INSERT=24,cinder:DELETE=6 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:40:14 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efb60566-bc76-403c-a4ce-13c09f82aa8c" returned: 0 in 0.917s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:14 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-quobyte-efb60566-bc76-403c-a4ce-13c09f82aa8c" released by "delete_volume" :: held 2.482s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:15 devstack cinder-volume[86191]: WARNING cinder.quota [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391625034-1510909860 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391625034-1510909860, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:15 devstack cinder-volume[86191]: WARNING cinder.quota [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391625034-1510909860 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-391625034-1510909860, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Created reservations ['1a4ebbde-2397-425c-8fd4-7b81c6347841', '7f4a3437-969f-49e6-ad02-f5d1fe8ceba4', '15c8bce2-f8a8-481a-a611-c4635ab23ec9', '55bcfada-0fa0-4a4f-a51c-811ef0587b1b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Created reservations ['bf7bfc15-1ced-42db-b983-74d021bb7885', 'b47bda4a-39d0-4f46-822e-cd5ee8f236a2', '5895bced-d10d-42c8-b6d3-23080fb5cf34', 'c36b0ece-4ac7-4f93-9cf2-7efa430f0421'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:15 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:15 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:15 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:15 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "cinder-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "cinder-quobyte-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-quobyte-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" acquired by "delete_volume" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeccc475-fff0-4840-9d7b-f53564847af8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "cinder-45fffb1d-cbe5-4864-acb7-57bd87cd444e-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-45fffb1d-cbe5-4864-acb7-57bd87cd444e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "cinder-quobyte-45fffb1d-cbe5-4864-acb7-57bd87cd444e" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-quobyte-45fffb1d-cbe5-4864-acb7-57bd87cd444e" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d6eab6-b1b7-485d-b723-5c96fcc47cdc]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:16 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a Jul 06 15:40:16 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:16 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e Jul 06 15:40:16 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:16 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.259s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:16 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Deleted volume successfully. Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ad2777b6-6fc0-4955-9927-cacfd9f95d41 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-efb60566-bc76-403c-a4ce-13c09f82aa8c-delete_volume" released by "delete_volume" :: held 4.250s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:16 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.511s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:16 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Deleted volume successfully. Jul 06 15:40:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-82ea8c9b-91de-4efd-9a32-ce8b793ef190 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-6b612660-dd61-4f64-b02f-4215402a80b9-delete_volume" released by "delete_volume" :: held 4.973s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:17 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" returned: 0 in 1.207s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:17 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a Jul 06 15:40:17 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:17 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e" returned: 0 in 1.371s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:17 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e Jul 06 15:40:17 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:17 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" returned: 0 in 0.907s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-quobyte-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a" released by "delete_volume" :: held 2.234s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Created reservations ['ad3025f3-9d38-4e9c-a558-74ad9d335faf', 'b0abd68e-1b57-4639-a47c-8a78c3b1ce9c', '697eef2d-6b84-4a02-a149-8d94ea895090', 'b91d6c70-76f0-40dc-b689-6c76ce85d8fa'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:18 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:18 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:18 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-45fffb1d-cbe5-4864-acb7-57bd87cd444e" returned: 0 in 0.886s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-quobyte-45fffb1d-cbe5-4864-acb7-57bd87cd444e" released by "delete_volume" :: held 2.347s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:18 devstack cinder-volume[86191]: WARNING cinder.quota [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1103953193-1408302547 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1103953193-1408302547, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:18 devstack cinder-volume[86191]: WARNING cinder.quota [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1103953193-1408302547 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1103953193-1408302547, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Created reservations ['592e65ef-421d-4407-972b-59f635ed09ed', '9f585af9-625e-42fd-aad9-e33621d8bc02', 'a6a70d16-99fc-4e4f-be60-c4d6425b4732', '29d2f264-88b8-4975-80d0-a9c25e038b52'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:18 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:40:18 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:19 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.916s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:19 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Deleted volume successfully. Jul 06 15:40:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d24be7cf-f404-4643-9309-456a0a3faae2 tempest-TestServerVolumeAttachmentScenario-787770676 None] Lock "cinder-bcdc7167-3c4d-4c29-b456-9e2ec760dc8a-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:19 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.965s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:19 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:40:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Deleted volume successfully. Jul 06 15:40:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f82e7177-e53a-4740-8e0e-cc4976c8f417 tempest-TestInstancesWithCinderVolumes-867529212 None] Lock "cinder-45fffb1d-cbe5-4864-acb7-57bd87cd444e-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (37efdb9d-917e-4028-98fe-fa12052d102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89490524-500e-47aa-8fd8-8137f604d4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89490524-500e-47aa-8fd8-8137f604d4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2103980636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b18b7c-df59-4349-8f0c-cf346a3668d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:29Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2348ca8d-5a45-49e3-b157-b160359131f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2348ca8d-5a45-49e3-b157-b160359131f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dbc15f-77f9-4767-8d37-94c5405e838e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dbc15f-77f9-4767-8d37-94c5405e838e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29b18b7c-df59-4349-8f0c-cf346a3668d6', 'volume_name': 'volume-29b18b7c-df59-4349-8f0c-cf346a3668d6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2660e7-8de6-48ae-af35-4a61099d5ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2660e7-8de6-48ae-af35-4a61099d5ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aca59e8-1f60-4f6a-b1ca-64c308a9a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume 29b18b7c-df59-4349-8f0c-cf346a3668d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29b18b7c-df59-4349-8f0c-cf346a3668d6', 'volume_size': 1} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2103980636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b18b7c-df59-4349-8f0c-cf346a3668d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:29Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating volume 29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:29 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:40:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:29 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 1073741824 Jul 06 15:40:29 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:30 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 1073741824" returned: 0 in 1.094s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:30 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 Jul 06 15:40:30 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:31 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6" returned: 0 in 0.850s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aca59e8-1f60-4f6a-b1ca-64c308a9a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b18b7c-df59-4349-8f0c-cf346a3668d6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e34443-af79-4e11-8acb-e0d4f12418f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 (29b18b7c-df59-4349-8f0c-cf346a3668d6): created successfully Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e34443-af79-4e11-8acb-e0d4f12418f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (37efdb9d-917e-4028-98fe-fa12052d102b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-704dba47-2b50-4841-a630-9e87a2ed1c85 tempest-VolumesSnapshotTestJSON-1481882308 None] Created volume successfully. Jul 06 15:40:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating offline snapshot 57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 of volume 29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:40:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef445185-b3f2-42c5-bdab-87a76665a891]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:32 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 Jul 06 15:40:32 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:33 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6" returned: 0 in 1.099s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:33 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 1G Jul 06 15:40:33 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:34 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 1G" returned: 0 in 1.081s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:34 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 Jul 06 15:40:34 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:35 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" returned: 0 in 1.218s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:35 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 is being set with open permissions: ugo+rw Jul 06 15:40:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:36 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 Jul 06 15:40:36 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:36 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" returned: 0 in 0.863s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:36 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info Jul 06 15:40:36 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:37 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info" returned: 0 in 0.735s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:37 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info is being set with open permissions: ugo+rw Jul 06 15:40:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:37 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info Jul 06 15:40:37 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:38 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.info" returned: 0 in 0.746s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.856s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d81c2a5a-18e2-4e2c-a67b-c4e2416fd846 tempest-VolumesSnapshotTestJSON-1481882308 None] Create snapshot completed successfully Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-57a4a61a-2e6d-43ba-926c-92a5cf61f9e4-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-57a4a61a-2e6d-43ba-926c-92a5cf61f9e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-29b18b7c-df59-4349-8f0c-cf346a3668d6" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-29b18b7c-df59-4349-8f0c-cf346a3668d6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleting offline snapshot 57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 of volume 29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] snapshot_file for this snap is: volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e3ccd9-a1b2-4b2e-a387-c65e27c910fd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:39 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 Jul 06 15:40:39 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:40 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" returned: 0 in 0.987s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29b18b7c-df59-4349-8f0c-cf346a3668d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:40:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cbdee9-2613-488f-9881-96b56e1a96cc]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:40 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 Jul 06 15:40:40 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:41 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6" returned: 0 in 0.821s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:41 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 Jul 06 15:40:41 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:41 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" returned: 0 in 0.803s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:41 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4 Jul 06 15:40:41 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:42 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6.57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" returned: 0 in 0.740s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-57a4a61a-2e6d-43ba-926c-92a5cf61f9e4" released by "_delete_snapshot" :: held 3.487s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-29b18b7c-df59-4349-8f0c-cf346a3668d6" released by "delete_snapshot" :: held 3.511s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['069d8788-c89f-4b53-84bd-6b6060941e7a', 'f9c50b7c-e845-49b0-b302-584737fc98fd', 'f61c58b3-cc61-4328-a879-56d267304053', '1f9402b8-9403-44d0-93eb-722648bdb9eb'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:40:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Delete snapshot completed successfully. Jul 06 15:40:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2942e25b-43e0-4b4f-81cb-59eeeb7f5c23 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-57a4a61a-2e6d-43ba-926c-92a5cf61f9e4-delete_snapshot" released by "delete_snapshot" :: held 3.800s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:40:43 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (8cff7c4d-8c75-4ae7-b7e9-66647c4f4051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0611e27-f24d-4065-8953-d7c7e02a0565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0611e27-f24d-4065-8953-d7c7e02a0565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-575537109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9486a8b1-e0f2-4499-ad9c-8aebb853ec67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:44Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f2fbfa-9497-4fcf-b529-68337aa99fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f2fbfa-9497-4fcf-b529-68337aa99fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6483cdf-8126-4ecf-ae5e-6dbd429c890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6483cdf-8126-4ecf-ae5e-6dbd429c890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9486a8b1-e0f2-4499-ad9c-8aebb853ec67', 'volume_name': 'volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71112e50-5ad5-4f21-92f1-c74e86666a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71112e50-5ad5-4f21-92f1-c74e86666a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8e49c2-63c2-43cb-a854-3f0cefe8bc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume 9486a8b1-e0f2-4499-ad9c-8aebb853ec67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67', 'volume_size': 1} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-575537109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9486a8b1-e0f2-4499-ad9c-8aebb853ec67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:44Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating volume 9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:44 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:40:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:44 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 1073741824 Jul 06 15:40:44 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:45 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 1073741824" returned: 0 in 1.052s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:45 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:40:45 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:45 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8e49c2-63c2-43cb-a854-3f0cefe8bc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f83b91-7361-480d-953e-ed0321d61301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:45 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 (9486a8b1-e0f2-4499-ad9c-8aebb853ec67): created successfully Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11f83b91-7361-480d-953e-ed0321d61301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:45 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (8cff7c4d-8c75-4ae7-b7e9-66647c4f4051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5e83d5ab-a30e-48d6-9e06-032ade722b67 tempest-VolumesSnapshotTestJSON-1481882308 None] Created volume successfully. Jul 06 15:40:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating offline snapshot 2d7c8014-ca50-48c5-bb59-cc2bd60d9298 of volume 9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:40:46 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[24513b7c-4593-491e-a6fb-d4312cedde23]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:46 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:40:46 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:47 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 0.921s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:47 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 1G Jul 06 15:40:47 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:48 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 1G" returned: 0 in 1.108s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:48 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 Jul 06 15:40:48 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:49 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298" returned: 0 in 0.956s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:49 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 is being set with open permissions: ugo+rw Jul 06 15:40:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:49 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 Jul 06 15:40:49 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:50 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298" returned: 0 in 0.734s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:50 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info Jul 06 15:40:50 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:51 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info" returned: 0 in 0.901s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:51 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info is being set with open permissions: ugo+rw Jul 06 15:40:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:51 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info Jul 06 15:40:51 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:51 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.info" returned: 0 in 0.920s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.670s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e40dabcb-d854-4e3b-bc1c-14aa6e8992d9 tempest-VolumesSnapshotTestJSON-1481882308 None] Create snapshot completed successfully Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (0db4cbdd-fe78-4eea-9c42-9a846259c90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f5de41-9459-4f97-b06f-f0499505ea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f5de41-9459-4f97-b06f-f0499505ea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1643783829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35048ca-578a-475a-80dd-5b0fe14069ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:40:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2d7c8014-ca50-48c5-bb59-cc2bd60d9298,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:40:53Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37969d1-8b2f-4540-bc9f-2f9af460a1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37969d1-8b2f-4540-bc9f-2f9af460a1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c77c06-165c-425d-a42a-c789743ee616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c77c06-165c-425d-a42a-c789743ee616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f35048ca-578a-475a-80dd-5b0fe14069ae', 'volume_name': 'volume-f35048ca-578a-475a-80dd-5b0fe14069ae', 'volume_size': 2, 'snapshot_id': '2d7c8014-ca50-48c5-bb59-cc2bd60d9298'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62005b1-2b41-4a82-87df-3bdc36afe36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62005b1-2b41-4a82-87df-3bdc36afe36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e214b8-27eb-4301-ab4c-4a4be8927d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:40:53 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume f35048ca-578a-475a-80dd-5b0fe14069ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f35048ca-578a-475a-80dd-5b0fe14069ae', 'volume_size': 2, 'snapshot_id': '2d7c8014-ca50-48c5-bb59-cc2bd60d9298'} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-2d7c8014-ca50-48c5-bb59-cc2bd60d9298-f35048ca-578a-475a-80dd-5b0fe14069ae" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2d7c8014-ca50-48c5-bb59-cc2bd60d9298-f35048ca-578a-475a-80dd-5b0fe14069ae" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating volume f35048ca-578a-475a-80dd-5b0fe14069ae from snapshot 2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-f35048ca-578a-475a-80dd-5b0fe14069ae" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-f35048ca-578a-475a-80dd-5b0fe14069ae" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] snapshot: 2d7c8014-ca50-48c5-bb59-cc2bd60d9298, volume: f35048ca-578a-475a-80dd-5b0fe14069ae, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca8a05c-3fa5-43b5-802e-0a2893ed0ca4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:53 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 Jul 06 15:40:53 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:54 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298" returned: 0 in 1.058s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:40:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:40:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:40:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[966cf0a8-8ca8-4b82-8e00-65b24e6d3810]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:54 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:40:54 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-78ae7249-325b-4ba0-982c-249da89cd4a4 tempest-TestShelveInstance-1102387538 None] Terminate volume connection completed successfully. Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-78ae7249-325b-4ba0-982c-249da89cd4a4 tempest-TestShelveInstance-1102387538 None] Deleting attachment f74906dc-295f-49af-96f5-c6e3be3ff183. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:40:55 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 0.953s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:55 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae Jul 06 15:40:55 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Acquiring lock "cinder-1df7535e-8ea3-4388-9fa2-3950269c5cf2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Lock "cinder-1df7535e-8ea3-4388-9fa2-3950269c5cf2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Acquiring lock "cinder-quobyte-1df7535e-8ea3-4388-9fa2-3950269c5cf2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:40:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Lock "cinder-quobyte-1df7535e-8ea3-4388-9fa2-3950269c5cf2" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:40:56 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdc2bb9-efc2-48d5-a537-22ee4c4284c0]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:40:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:56 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:40:56 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:57 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 1.736s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:58 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:40:58 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:40:59 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 06 15:40:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 1 in 1.452s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:40:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:40:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:40:59 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2 Jul 06 15:40:59 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:01 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1df7535e-8ea3-4388-9fa2-3950269c5cf2" returned: 0 in 2.202s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Lock "cinder-quobyte-1df7535e-8ea3-4388-9fa2-3950269c5cf2" released by "delete_volume" :: held 5.531s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG cinder.quota [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Created reservations ['26eef39a-1120-40f0-abf8-e288d9acca0e', '002d64b7-d4f6-497e-abb0-8a65cc9e1424', 'a759474f-1b07-4eb2-bc4a-a5289596cbde', 'ca980a19-98c3-45b3-b49e-aca6afd92fca'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:01 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:01 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:02 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae" returned: 0 in 6.890s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:02 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[17377b81-c62e-4f9c-a9cf-3980cf650de9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:02 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:41:02 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:03 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.136s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:03 devstack cinder-volume[86191]: DEBUG cinder.manager [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:03 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Deleted volume successfully. Jul 06 15:41:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [req-09d42656-99ad-4013-83b0-513d9fe4ec61 req-50d04e07-6c74-491c-9215-4cd1c5cd451f tempest-TestShelveInstance-1102387538 None] Lock "cinder-1df7535e-8ea3-4388-9fa2-3950269c5cf2-delete_volume" released by "delete_volume" :: held 7.218s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:03 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 1.222s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:03 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:41:03 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Converted 1024.00 MB image at 148.59 MB/s Jul 06 15:41:03 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae is being set with open permissions: ugo+rw Jul 06 15:41:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:03 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae Jul 06 15:41:03 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:04 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae" returned: 0 in 0.692s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-f35048ca-578a-475a-80dd-5b0fe14069ae" released by "_copy_volume_from_snapshot" :: held 10.937s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2d7c8014-ca50-48c5-bb59-cc2bd60d9298-f35048ca-578a-475a-80dd-5b0fe14069ae" released by "_create_volume_from_snapshot" :: held 10.976s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.995s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e214b8-27eb-4301-ab4c-4a4be8927d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35048ca-578a-475a-80dd-5b0fe14069ae', 'volume_size': 2, 'snapshot_id': '2d7c8014-ca50-48c5-bb59-cc2bd60d9298'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666e4c1c-c998-47c9-affb-3b6b99a10a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume volume-f35048ca-578a-475a-80dd-5b0fe14069ae (f35048ca-578a-475a-80dd-5b0fe14069ae): created successfully Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666e4c1c-c998-47c9-affb-3b6b99a10a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (0db4cbdd-fe78-4eea-9c42-9a846259c90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4186b743-9c68-4474-9266-4b1288c6e713 tempest-VolumesSnapshotTestJSON-1481882308 None] Created volume successfully. Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-f35048ca-578a-475a-80dd-5b0fe14069ae-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-f35048ca-578a-475a-80dd-5b0fe14069ae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-f35048ca-578a-475a-80dd-5b0fe14069ae" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-f35048ca-578a-475a-80dd-5b0fe14069ae" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9c441b-0a0e-47d8-be28-50f1e9d29525]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:05 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae Jul 06 15:41:05 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:06 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae" returned: 0 in 1.137s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:06 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae Jul 06 15:41:06 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:06 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:06 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:06 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f35048ca-578a-475a-80dd-5b0fe14069ae" returned: 0 in 0.803s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-f35048ca-578a-475a-80dd-5b0fe14069ae" released by "delete_volume" :: held 2.026s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['da0e400f-075f-4c91-8259-60e2f8b9e268', '6e65dc1a-f49d-4a04-9f16-b2fb50e7cfb6', 'bffa3861-3663-4bf6-bedb-0992eb9c3b1d', '662b39a1-eea6-4cc2-a162-622494e5b0da'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:07 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:07 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:07 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.003s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:41:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:41:08 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.061s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleted volume successfully. Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c20aef5-b410-4b00-a315-0b186ee30ae6 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-f35048ca-578a-475a-80dd-5b0fe14069ae-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-2d7c8014-ca50-48c5-bb59-cc2bd60d9298-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-2d7c8014-ca50-48c5-bb59-cc2bd60d9298-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-2d7c8014-ca50-48c5-bb59-cc2bd60d9298" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2d7c8014-ca50-48c5-bb59-cc2bd60d9298" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleting offline snapshot 2d7c8014-ca50-48c5-bb59-cc2bd60d9298 of volume 9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] snapshot_file for this snap is: volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb85cd8-07b8-41db-802a-c7b717b2d08b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:08 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 Jul 06 15:41:08 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:09 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298" returned: 0 in 0.879s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[94334079-d110-4b2f-a3c0-77e6636107ef]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:09 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:41:09 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:10 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 0.870s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:10 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 Jul 06 15:41:10 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:11 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298" returned: 0 in 0.987s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:11 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298 Jul 06 15:41:11 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:12 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67.2d7c8014-ca50-48c5-bb59-cc2bd60d9298" returned: 0 in 0.809s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2d7c8014-ca50-48c5-bb59-cc2bd60d9298" released by "_delete_snapshot" :: held 3.673s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" released by "delete_snapshot" :: held 3.707s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['4f9a6122-ab1b-4d7c-abec-00ce4b0b8dc2', 'afcb0bd2-d1e2-42a6-ae05-bceec45feadb', '204f494a-94b7-42a7-8cf4-ab57530e6622', '1e937255-fb96-48ef-a0b3-aa46bda72987'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Delete snapshot completed successfully. Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-abe0a47c-f739-4346-b575-b7da7c5161b5 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-2d7c8014-ca50-48c5-bb59-cc2bd60d9298-delete_snapshot" released by "delete_snapshot" :: held 3.898s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-9486a8b1-e0f2-4499-ad9c-8aebb853ec67-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-9486a8b1-e0f2-4499-ad9c-8aebb853ec67-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:13 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceadfe5e-1573-416c-91b1-5d7fe4a9fdc6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:13 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:41:13 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:13 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 0.886s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:13 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67 Jul 06 15:41:13 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:14 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-9486a8b1-e0f2-4499-ad9c-8aebb853ec67" released by "delete_volume" :: held 1.809s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:DELETE=8,cinder:SELECT=66,cinder:INSERT=19,cinder:UPDATE=69 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['9c3d87bd-de96-4c29-a845-e7b0fd54ea25', 'cf094a37-6b4d-4aee-977c-9ed25011d321', '19ebfd44-6472-4eae-9226-d167cc91a1ae', '538fd2b7-1bfe-40a2-a951-5fddd6a8aae4'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:14 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:14 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=61,cinder:INSERT=18,cinder:UPDATE=80,cinder:DELETE=4 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (ab169b56-b230-4916-9935-7d94f5c3918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3974e8-5d66-48ee-b3cf-c1557924b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3974e8-5d66-48ee-b3cf-c1557924b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524161468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c973365-e44e-422c-87da-7bd19ec0f7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:16Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570c30f6-40bc-48c7-a2d0-62e663543603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570c30f6-40bc-48c7-a2d0-62e663543603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c87d4a6-70e6-4eec-8a0e-1e89ae1034eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:16 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c87d4a6-70e6-4eec-8a0e-1e89ae1034eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c973365-e44e-422c-87da-7bd19ec0f7a2', 'volume_name': 'volume-2c973365-e44e-422c-87da-7bd19ec0f7a2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d84c4-454b-49c7-8efb-aff1caded0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d84c4-454b-49c7-8efb-aff1caded0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f406c-7659-473a-b490-d56b32a560c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:16 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume 2c973365-e44e-422c-87da-7bd19ec0f7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c973365-e44e-422c-87da-7bd19ec0f7a2', 'volume_size': 1} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524161468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c973365-e44e-422c-87da-7bd19ec0f7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:16Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating volume 2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:16 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.317s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:16 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Deleted volume successfully. Jul 06 15:41:16 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 1073741824 Jul 06 15:41:16 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-166d4111-ecac-4a9e-a2fe-641771e926ad tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-9486a8b1-e0f2-4499-ad9c-8aebb853ec67-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:17 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 1073741824" returned: 0 in 1.379s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:17 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:17 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Flow 'volume_create_manager' (47513453-46b0-4226-bab1-28c89a3e9204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35431536-43b2-4e9e-b4d0-a1768ea2a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35431536-43b2-4e9e-b4d0-a1768ea2a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2122536839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe2719c-20b6-48f6-9592-f197e3e78a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76379f98a5744843bb6eb2a4d61300de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:18Z,use_quota=True,user_id='6bfb848f304f4fcfadee2c2298985989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29491c1-9a06-4be9-8c18-371e2576749b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29491c1-9a06-4be9-8c18-371e2576749b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d396ef-bb54-4563-ba2a-a3e0e205904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d396ef-bb54-4563-ba2a-a3e0e205904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe2719c-20b6-48f6-9592-f197e3e78a67', 'volume_name': 'volume-efe2719c-20b6-48f6-9592-f197e3e78a67', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91f0d5b-3050-4d2b-a167-ca90d55f7189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a91f0d5b-3050-4d2b-a167-ca90d55f7189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f07a3-ed97-406f-b254-193256085f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:17 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Volume efe2719c-20b6-48f6-9592-f197e3e78a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe2719c-20b6-48f6-9592-f197e3e78a67', 'volume_size': 1} Jul 06 15:41:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:18 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 0.912s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] <== create_volume: return (2361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.364s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2122536839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe2719c-20b6-48f6-9592-f197e3e78a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76379f98a5744843bb6eb2a4d61300de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:18Z,use_quota=True,user_id='6bfb848f304f4fcfadee2c2298985989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Creating volume efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:18 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f406c-7659-473a-b490-d56b32a560c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c973365-e44e-422c-87da-7bd19ec0f7a2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:18 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 1073741824 Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91a313c-69e2-4925-aefb-c88427b63b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:18 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:18 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 (2c973365-e44e-422c-87da-7bd19ec0f7a2): created successfully Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91a313c-69e2-4925-aefb-c88427b63b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (ab169b56-b230-4916-9935-7d94f5c3918d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:18 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-679c7810-fc09-4f55-a1ce-87fd5e7c4369 tempest-VolumesSnapshotTestJSON-1481882308 None] Created volume successfully. Jul 06 15:41:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:20 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 1073741824" returned: 0 in 1.437s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:20 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:41:20 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:20 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 0.850s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.383s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.179s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f07a3-ed97-406f-b254-193256085f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe2719c-20b6-48f6-9592-f197e3e78a67', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aa88cc-f071-49d9-bd84-6a7a59ad46fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Creating offline snapshot 85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd of volume 2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:41:21 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Volume volume-efe2719c-20b6-48f6-9592-f197e3e78a67 (efe2719c-20b6-48f6-9592-f197e3e78a67): created successfully Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12aa88cc-f071-49d9-bd84-6a7a59ad46fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Flow 'volume_create_manager' (47513453-46b0-4226-bab1-28c89a3e9204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9fe556-52a6-4f15-817f-2b60e2e0d8c8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:21 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-676c4240-dd2b-4a63-bee8-47a424ebfb26 tempest-TestStampPattern-470785233 None] Created volume successfully. Jul 06 15:41:21 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:21 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:22 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 1.170s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:22 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd 1G Jul 06 15:41:22 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:23 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd 1G" returned: 0 in 0.929s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:23 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd Jul 06 15:41:23 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:24 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" returned: 0 in 0.863s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:24 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd is being set with open permissions: ugo+rw Jul 06 15:41:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:24 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd Jul 06 15:41:24 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:24 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" returned: 0 in 0.908s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:25 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info Jul 06 15:41:25 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Flow 'volume_create_manager' (32ca3524-bbc0-45ca-8e07-ca45bcf4cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aef3ba7-907c-4350-b6b7-f217714f7b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aef3ba7-907c-4350-b6b7-f217714f7b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-761183027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf2c774-3897-4292-aed0-acb7c4f77493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b1eb0bf3ad48a6ae94db1c8d70cb9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:26Z,use_quota=True,user_id='7169cdd66f154e6a88226a554664d1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695ee1ae-fae7-4e16-85a7-c5037e7aa941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695ee1ae-fae7-4e16-85a7-c5037e7aa941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:25 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25fa2ab-635f-47c6-9df9-b6a1b44679ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25fa2ab-635f-47c6-9df9-b6a1b44679ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf2c774-3897-4292-aed0-acb7c4f77493', 'volume_name': 'volume-bcf2c774-3897-4292-aed0-acb7c4f77493', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fa0ba6-fa0a-4c72-b84c-411665b5904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fa0ba6-fa0a-4c72-b84c-411665b5904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708076db-8d74-49af-bc0d-b88084393564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Volume bcf2c774-3897-4292-aed0-acb7c4f77493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf2c774-3897-4292-aed0-acb7c4f77493', 'volume_size': 1} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info" returned: 0 in 0.947s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:25 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info is being set with open permissions: ugo+rw Jul 06 15:41:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:25 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info Jul 06 15:41:25 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:26 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.info" returned: 0 in 0.705s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.687s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-761183027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf2c774-3897-4292-aed0-acb7c4f77493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b1eb0bf3ad48a6ae94db1c8d70cb9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:26Z,use_quota=True,user_id='7169cdd66f154e6a88226a554664d1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Creating volume bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:26 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:41:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:26 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 1073741824 Jul 06 15:41:26 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:26 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-52bccbc7-2676-40f4-bab8-f350b58ddf9d tempest-VolumesSnapshotTestJSON-1481882308 None] Create snapshot completed successfully Jul 06 15:41:27 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 1073741824" returned: 0 in 1.264s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:28 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:41:28 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (20bf0af6-048f-4cbb-aee6-ad73add8b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dd8f4c-c4b0-43a6-a097-cd9d59b9d46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5dd8f4c-c4b0-43a6-a097-cd9d59b9d46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1906849119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df1f7f8-1dd6-4e77-8154-59073a21372a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99772fcca95849749579b6c040d3fa31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:28Z,use_quota=True,user_id='886f1bacaf4046b2bf0fd376f7f720e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76a466c-b3e9-422a-b8c4-58fa712f4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76a466c-b3e9-422a-b8c4-58fa712f4a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740202b7-5009-4314-b23b-93f58ad462c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740202b7-5009-4314-b23b-93f58ad462c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8df1f7f8-1dd6-4e77-8154-59073a21372a', 'volume_name': 'volume-8df1f7f8-1dd6-4e77-8154-59073a21372a', 'volume_size': 1, 'snapshot_id': '85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71441b71-7b4e-4a64-a892-a3c22657d3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71441b71-7b4e-4a64-a892-a3c22657d3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373cd12d-6bfa-455c-a676-284b1fd860f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume 8df1f7f8-1dd6-4e77-8154-59073a21372a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8df1f7f8-1dd6-4e77-8154-59073a21372a', 'volume_size': 1, 'snapshot_id': '85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd'} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:28 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 0.995s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.800s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd-8df1f7f8-1dd6-4e77-8154-59073a21372a" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd-8df1f7f8-1dd6-4e77-8154-59073a21372a" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating volume 8df1f7f8-1dd6-4e77-8154-59073a21372a from snapshot 85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-8df1f7f8-1dd6-4e77-8154-59073a21372a" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (708076db-8d74-49af-bc0d-b88084393564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf2c774-3897-4292-aed0-acb7c4f77493', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cfc3e6-936a-49da-99f5-a6bafa4aa394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-8df1f7f8-1dd6-4e77-8154-59073a21372a" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] snapshot: 85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd, volume: 8df1f7f8-1dd6-4e77-8154-59073a21372a, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:41:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Volume volume-bcf2c774-3897-4292-aed0-acb7c4f77493 (bcf2c774-3897-4292-aed0-acb7c4f77493): created successfully Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cfc3e6-936a-49da-99f5-a6bafa4aa394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Flow 'volume_create_manager' (32ca3524-bbc0-45ca-8e07-ca45bcf4cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-933dcb25-9d5f-4207-98b2-db02aa510add tempest-VolumeDependencyTests-581253382 None] Created volume successfully. Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ddf69-264c-4916-86c1-854568d19c4f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:29 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd Jul 06 15:41:29 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:30 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" returned: 0 in 1.373s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c973365-e44e-422c-87da-7bd19ec0f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0178e0e2-e05c-462c-92e8-e582413166ab]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:30 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:30 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:31 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 0.993s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:31 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:41:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:31 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a Jul 06 15:41:31 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:40 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:DELETE=4,cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:40 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:41:40 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a" returned: 0 in 9.214s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4e6e9-9c14-4986-a6cc-f0fdb4407ab3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:41 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:41 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:42 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 2.136s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:42 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2, size 1024.00 MB, duration 9.21 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:41:42 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Converted 1024.00 MB image at 111.13 MB/s Jul 06 15:41:42 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a is being set with open permissions: ugo+rw Jul 06 15:41:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:42 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a Jul 06 15:41:42 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Flow 'volume_create_manager' (4e414f47-05cc-47d2-aa9a-9cb6594d0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ac35d4-8807-4959-804c-15100b1fc10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ac35d4-8807-4959-804c-15100b1fc10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-405336093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d6aeb1-ccc4-4782-b614-0df1b76bc47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f95eccb68e7484fb4322673d08d7618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:43Z,use_quota=True,user_id='c746e065e7134ebdb7cfef63e4f96bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c207761-0016-402c-8e7f-86be34386637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c207761-0016-402c-8e7f-86be34386637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02d330f-f6b1-4976-8cfa-c8e2401abe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b02d330f-f6b1-4976-8cfa-c8e2401abe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d6aeb1-ccc4-4782-b614-0df1b76bc47d', 'volume_name': 'volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07589406-cbc9-432e-872b-7161ebc8d8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07589406-cbc9-432e-872b-7161ebc8d8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ff91a0-e76b-4f2a-8252-d1c07013acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:43 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Volume a4d6aeb1-ccc4-4782-b614-0df1b76bc47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d', 'volume_size': 1} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:43 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a" returned: 0 in 1.004s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-8df1f7f8-1dd6-4e77-8154-59073a21372a" released by "_copy_volume_from_snapshot" :: held 14.880s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd-8df1f7f8-1dd6-4e77-8154-59073a21372a" released by "_create_volume_from_snapshot" :: held 14.944s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.982s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.435s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Creating offline snapshot 9f212870-01b7-4632-88ed-cf270306c45f of volume bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373cd12d-6bfa-455c-a676-284b1fd860f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df1f7f8-1dd6-4e77-8154-59073a21372a', 'volume_size': 1, 'snapshot_id': '85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ee1644-5c6b-4426-859c-3df5f46bd9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab40d721-955d-4db3-8406-4e612cd764ab]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Volume volume-8df1f7f8-1dd6-4e77-8154-59073a21372a (8df1f7f8-1dd6-4e77-8154-59073a21372a): created successfully Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95ee1644-5c6b-4426-859c-3df5f46bd9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Flow 'volume_create_manager' (20bf0af6-048f-4cbb-aee6-ad73add8b088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-998a7a1a-90b5-48bb-9661-6171e8ace0d8 tempest-VolumesSnapshotTestJSON-1481882308 None] Created volume successfully. Jul 06 15:41:44 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:41:44 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-8df1f7f8-1dd6-4e77-8154-59073a21372a-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-8df1f7f8-1dd6-4e77-8154-59073a21372a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-8df1f7f8-1dd6-4e77-8154-59073a21372a" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-8df1f7f8-1dd6-4e77-8154-59073a21372a" acquired by "delete_volume" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dbaad8-a5d3-4fab-97f1-f7da10665b62]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:45 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a Jul 06 15:41:45 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:45 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 1.621s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:45 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f 1G Jul 06 15:41:45 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:46 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a" returned: 0 in 1.341s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:46 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a Jul 06 15:41:46 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:46 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f 1G" returned: 0 in 1.154s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf2c774-3897-4292-aed0-acb7c4f77493 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:46 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf2c774-3897-4292-aed0-acb7c4f77493 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f Jul 06 15:41:46 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:47 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8df1f7f8-1dd6-4e77-8154-59073a21372a" returned: 0 in 0.785s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-8df1f7f8-1dd6-4e77-8154-59073a21372a" released by "delete_volume" :: held 2.219s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['320dc77c-241c-47ff-864f-3184712c55d4', 'fd0bcc93-3a57-40c2-baa9-7a7827710e42', 'd82aea94-b3ca-4228-8531-ba2c099050fd', '29e25753-14ab-4426-b140-007c45f1b51e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:47 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:47 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:47 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf2c774-3897-4292-aed0-acb7c4f77493 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f" returned: 0 in 0.982s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:47 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f is being set with open permissions: ugo+rw Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:47 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f Jul 06 15:41:47 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:47 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.721s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleted volume successfully. Jul 06 15:41:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b85a3742-f31f-482e-976b-e7e1d24e11b1 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-8df1f7f8-1dd6-4e77-8154-59073a21372a-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-2c973365-e44e-422c-87da-7bd19ec0f7a2" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2c973365-e44e-422c-87da-7bd19ec0f7a2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleting offline snapshot 85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd of volume 2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] snapshot_file for this snap is: volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432eaa2-d396-4cbc-9987-ff2658a32f26]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:48 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd Jul 06 15:41:48 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:48 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f" returned: 0 in 0.672s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:48 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info Jul 06 15:41:48 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:49 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" returned: 0 in 0.813s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c973365-e44e-422c-87da-7bd19ec0f7a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a8f0aa-124f-41c4-a65e-4ad414de1926]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:49 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info" returned: 0 in 0.680s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:49 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info is being set with open permissions: ugo+rw Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:49 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info Jul 06 15:41:49 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:49 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:49 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:49 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.info" returned: 0 in 0.651s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.912s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.457s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-405336093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d6aeb1-ccc4-4782-b614-0df1b76bc47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f95eccb68e7484fb4322673d08d7618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:43Z,use_quota=True,user_id='c746e065e7134ebdb7cfef63e4f96bc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Creating volume a4d6aeb1-ccc4-4782-b614-0df1b76bc47d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:49 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:41:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:49 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d 1073741824 Jul 06 15:41:49 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1ebc4c7b-4882-41e6-9774-d7cf685920c0 tempest-VolumeDependencyTests-581253382 None] Create snapshot completed successfully Jul 06 15:41:50 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 0.811s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:50 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd Jul 06 15:41:50 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:50 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" returned: 0 in 0.909s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:50 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:41:50 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd Jul 06 15:41:50 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Flow 'volume_create_manager' (8f39da6a-dd88-47de-b6f1-e6eb41f690ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ad5fba-5991-4803-9ad9-e58a42fee1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ad5fba-5991-4803-9ad9-e58a42fee1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-15363127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83b4209-bbb4-4a0a-acf9-2c5e2586e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7b1eb0bf3ad48a6ae94db1c8d70cb9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f212870-01b7-4632-88ed-cf270306c45f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:41:51Z,use_quota=True,user_id='7169cdd66f154e6a88226a554664d1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564e3fdb-1cce-41cb-8a5e-c6db3ec5d6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564e3fdb-1cce-41cb-8a5e-c6db3ec5d6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:51 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46302ea9-0c45-4e4a-8344-77e617f6b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46302ea9-0c45-4e4a-8344-77e617f6b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c83b4209-bbb4-4a0a-acf9-2c5e2586e672', 'volume_name': 'volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672', 'volume_size': 1, 'snapshot_id': '9f212870-01b7-4632-88ed-cf270306c45f'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f672c6-fcc6-458e-9a96-ba6498fadbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f672c6-fcc6-458e-9a96-ba6498fadbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbe0cf6-56b1-47ac-85e2-1bab699a88fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Volume c83b4209-bbb4-4a0a-acf9-2c5e2586e672: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672', 'volume_size': 1, 'snapshot_id': '9f212870-01b7-4632-88ed-cf270306c45f'} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d 1073741824" returned: 0 in 1.118s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:51 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d Jul 06 15:41:51 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:51 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2.85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd" released by "_delete_snapshot" :: held 3.321s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2c973365-e44e-422c-87da-7bd19ec0f7a2" released by "delete_snapshot" :: held 3.350s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['4b4ac965-46be-45be-aa75-6e7e25409d5a', '173d191b-b3a3-4690-aa66-8568a843855b', 'bcf22691-e434-4fbf-a62f-8950e53c9eb4', '69614d66-acdd-4125-bee5-941f4a9c0a64'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:51 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" returned: 0 in 0.718s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.744s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-quobyte-9f212870-01b7-4632-88ed-cf270306c45f-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Delete snapshot completed successfully. Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-183ca226-94ef-4a42-a9fa-c32538dd2696 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-85328fc4-f7d5-4f14-89e5-1eb4e4c8e7cd-delete_snapshot" released by "delete_snapshot" :: held 3.585s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ff91a0-e76b-4f2a-8252-d1c07013acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6411729-24df-4965-9c9c-001ffc482dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-9f212870-01b7-4632-88ed-cf270306c45f-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Creating volume c83b4209-bbb4-4a0a-acf9-2c5e2586e672 from snapshot 9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-quobyte-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Volume volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d (a4d6aeb1-ccc4-4782-b614-0df1b76bc47d): created successfully Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6411729-24df-4965-9c9c-001ffc482dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Flow 'volume_create_manager' (4e414f47-05cc-47d2-aa9a-9cb6594d0885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] snapshot: 9f212870-01b7-4632-88ed-cf270306c45f, volume: c83b4209-bbb4-4a0a-acf9-2c5e2586e672, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:41:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-70f9df8b-ff31-4c19-b292-b3fd2c3a395c tempest-TestMinimumBasicScenario-2137637497 None] Created volume successfully. Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d43e5a9-8398-4ed5-af99-7ea1d2bcede7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:52 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f Jul 06 15:41:52 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-2c973365-e44e-422c-87da-7bd19ec0f7a2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-2c973365-e44e-422c-87da-7bd19ec0f7a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-2c973365-e44e-422c-87da-7bd19ec0f7a2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2c973365-e44e-422c-87da-7bd19ec0f7a2" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5ac263-9d2a-4292-9d33-b742a32f019e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:52 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f" returned: 0 in 0.784s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcf2c774-3897-4292-aed0-acb7c4f77493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6a300f-7aac-4fcb-bd0a-83350deecfef]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:52 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:52 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:52 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:41:52 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:53 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 0.999s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:53 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:53 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2 Jul 06 15:41:53 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 0.957s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:53 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:41:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:53 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 Jul 06 15:41:53 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:54 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2c973365-e44e-422c-87da-7bd19ec0f7a2" returned: 0 in 0.752s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-2c973365-e44e-422c-87da-7bd19ec0f7a2" released by "delete_volume" :: held 1.809s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['4049b37e-0fef-4bab-b072-5da805dd089f', 'b4c01b26-e840-4e76-8c59-a926f8236b76', '49a534ef-9ba0-4522-b303-d6aa86d41c02', 'a0bae860-2098-4140-8f0a-7060b6211f23'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:54 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:54 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-29b18b7c-df59-4349-8f0c-cf346a3668d6-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-29b18b7c-df59-4349-8f0c-cf346a3668d6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "cinder-quobyte-29b18b7c-df59-4349-8f0c-cf346a3668d6" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:41:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-29b18b7c-df59-4349-8f0c-cf346a3668d6" acquired by "delete_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:41:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aedc966-e472-4693-b0a7-083ff13b19f8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:56 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.462s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:56 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:41:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleted volume successfully. Jul 06 15:41:56 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 Jul 06 15:41:56 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2ff2e8b5-292f-4178-885e-04c8549e57c0 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-2c973365-e44e-422c-87da-7bd19ec0f7a2-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:57 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6" returned: 0 in 1.919s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:57 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6 Jul 06 15:41:57 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:59 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-29b18b7c-df59-4349-8f0c-cf346a3668d6" returned: 0 in 1.899s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-quobyte-29b18b7c-df59-4349-8f0c-cf346a3668d6" released by "delete_volume" :: held 3.980s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Created reservations ['60db676a-18a7-4913-be96-6172363e29bf', 'eaff4f1e-3d24-4fd6-a994-4d98e5cf7d19', 'efd40664-2614-4a29-ad0c-85c49249e9bb', '3f5ac559-35d3-4d12-b5f7-f00ebb9547e8'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:41:59 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:41:59 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:41:59 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" returned: 0 in 6.171s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2683753a-30b0-4a2a-8fe5-10b12091066d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:41:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:00 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:42:00 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:00 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Deleted volume successfully. Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8002d6a9-594c-46ae-8d99-63ac5a25b798 tempest-VolumesSnapshotTestJSON-1481882308 None] Lock "cinder-29b18b7c-df59-4349-8f0c-cf346a3668d6-delete_volume" released by "delete_volume" :: held 5.245s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:00 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 0.978s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:42:00 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Converted 1024.00 MB image at 165.91 MB/s Jul 06 15:42:00 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 is being set with open permissions: ugo+rw Jul 06 15:42:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:00 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 Jul 06 15:42:00 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:01 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" released by "_copy_volume_from_snapshot" :: held 9.609s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-9f212870-01b7-4632-88ed-cf270306c45f-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" released by "_create_volume_from_snapshot" :: held 9.663s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.717s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.738s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc7c0b3-8c20-4ae2-810e-553eb656691b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbe0cf6-56b1-47ac-85e2-1bab699a88fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672', 'volume_size': 1, 'snapshot_id': '9f212870-01b7-4632-88ed-cf270306c45f'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd876468-6e4d-4192-aa1b-a7c5ad9a89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Volume volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 (c83b4209-bbb4-4a0a-acf9-2c5e2586e672): created successfully Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd876468-6e4d-4192-aa1b-a7c5ad9a89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Flow 'volume_create_manager' (8f39da6a-dd88-47de-b6f1-e6eb41f690ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b55ea266-af16-46e3-8024-4afe5313300e tempest-VolumeDependencyTests-581253382 None] Created volume successfully. Jul 06 15:42:01 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d Jul 06 15:42:01 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:02 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" returned: 0 in 0.722s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.742s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.157s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:02 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f82e8f3-68e7-4ff0-b7e8-e51136cda4fd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cb85d05-0933-4d61-84dd-6ad93434be63', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:42:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-bdab9dda-cb77-41d0-83a9-e444370b439b req-396d7d60-988c-4f48-b8d8-1baf2c5c1a30 tempest-TestMinimumBasicScenario-2137637497 None] attachment_update completed successfully. Jul 06 15:42:02 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:42:02 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-9f212870-01b7-4632-88ed-cf270306c45f-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-9f212870-01b7-4632-88ed-cf270306c45f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-quobyte-bcf2c774-3897-4292-aed0-acb7c4f77493" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-bcf2c774-3897-4292-aed0-acb7c4f77493" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-quobyte-9f212870-01b7-4632-88ed-cf270306c45f" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-9f212870-01b7-4632-88ed-cf270306c45f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Deleting offline snapshot 9f212870-01b7-4632-88ed-cf270306c45f of volume bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] snapshot_file for this snap is: volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78dc92-b8a1-4b4f-bde3-fc376d5de67c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:03 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 0.831s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-efe2719c-20b6-48f6-9592-f197e3e78a67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fdd5e75-1af0-4fa3-b3c8-2b8bdbd6d39f', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:42:03 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f Jul 06 15:42:03 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:03 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-6d478d03-8dd2-4fa1-949e-91ba4daea0b5 req-51efbcda-97af-449d-8b8d-44965449cf60 tempest-TestStampPattern-470785233 None] attachment_update completed successfully. Jul 06 15:42:04 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f" returned: 0 in 0.929s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcf2c774-3897-4292-aed0-acb7c4f77493(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:42:04 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64b5344-db21-4704-927d-fa6e06075ff9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:04 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:42:04 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:04 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 0.834s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:04 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f Jul 06 15:42:04 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:05 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f" returned: 0 in 0.788s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:05 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f Jul 06 15:42:05 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:06 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493.9f212870-01b7-4632-88ed-cf270306c45f" returned: 0 in 0.835s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-9f212870-01b7-4632-88ed-cf270306c45f" released by "_delete_snapshot" :: held 3.523s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-bcf2c774-3897-4292-aed0-acb7c4f77493" released by "delete_snapshot" :: held 3.553s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Created reservations ['da86704a-2170-4427-97e5-5294b75d403e', '06dd5b00-0e1e-4fbe-917f-c03fffd9ee8a', 'edeb2aff-4462-4c4e-a67a-ddaa5230606f', 'c04511a3-f1ef-4df2-9df3-2e67764444dd'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Delete snapshot completed successfully. Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0441ded9-70fe-4429-90b1-a3b80a348ca6 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-9f212870-01b7-4632-88ed-cf270306c45f-delete_snapshot" released by "delete_snapshot" :: held 3.720s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:06 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:42:06 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-bcf2c774-3897-4292-aed0-acb7c4f77493-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Lock "cinder-bcf2c774-3897-4292-aed0-acb7c4f77493-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-quobyte-bcf2c774-3897-4292-aed0-acb7c4f77493" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-bcf2c774-3897-4292-aed0-acb7c4f77493" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b44a7a7-9974-4b95-b83f-64be78b7fb5e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:07 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:42:07 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:07 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.028s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:42:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:42:08 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 1.253s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:08 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493 Jul 06 15:42:08 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:09 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcf2c774-3897-4292-aed0-acb7c4f77493" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-bcf2c774-3897-4292-aed0-acb7c4f77493" released by "delete_volume" :: held 2.217s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Created reservations ['7e5e2344-236d-4c5d-b3bd-82ee7697760f', '76b51d4f-ab49-405f-bf8b-58b54ac3a8d7', '594725c4-244c-4a2c-9bac-118cf9462c15', '0e38742b-a3e5-4802-a647-21feea9c11fa'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:09 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:42:09 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:10 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.921s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Deleted volume successfully. Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-47ec3579-d798-418d-988f-6f108da4449b tempest-VolumeDependencyTests-581253382 None] Lock "cinder-bcf2c774-3897-4292-aed0-acb7c4f77493-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-c83b4209-bbb4-4a0a-acf9-2c5e2586e672-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-c83b4209-bbb4-4a0a-acf9-2c5e2586e672-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "cinder-quobyte-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:11 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f46538-4604-46d3-acd1-5e9ee2021c4a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:11 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 Jul 06 15:42:11 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:12 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" returned: 0 in 1.152s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:12 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672 Jul 06 15:42:12 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-074458a0-e50f-41cc-be84-ba933f4db939 req-f7546c37-7c52-4507-83e6-46868379472d tempest-TestStampPattern-470785233 None] Terminate volume connection completed successfully. Jul 06 15:42:12 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-074458a0-e50f-41cc-be84-ba933f4db939 req-f7546c37-7c52-4507-83e6-46868379472d tempest-TestStampPattern-470785233 None] Deleting attachment 2fdd5e75-1af0-4fa3-b3c8-2b8bdbd6d39f. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:42:12 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" returned: 0 in 0.808s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-quobyte-c83b4209-bbb4-4a0a-acf9-2c5e2586e672" released by "delete_volume" :: held 2.033s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Created reservations ['93cf42a0-e17b-4f8c-9e15-f79e9d03519f', 'c07beeac-9bf5-40e2-a1b6-fd0842e115f5', '36a11008-4e02-44fe-914a-a023a0237bc7', 'c97fc1f7-16a5-4f82-be18-a100861471d0'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:13 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:42:13 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:13 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.736s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Deleted volume successfully. Jul 06 15:42:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5810668d-9981-4d47-9399-11b3aab742b0 tempest-VolumeDependencyTests-581253382 None] Lock "cinder-c83b4209-bbb4-4a0a-acf9-2c5e2586e672-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Creating offline snapshot fb4d7151-c7ac-4efa-acbb-f39084ddfea9 of volume efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:42:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd210c8-2a44-44fe-a8f0-5096333f2650]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:14 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:42:14 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:15 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 0.860s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:15 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 1G Jul 06 15:42:15 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:16 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 1G" returned: 0 in 1.064s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe2719c-20b6-48f6-9592-f197e3e78a67 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:16 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe2719c-20b6-48f6-9592-f197e3e78a67 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 Jul 06 15:42:16 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:17 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efe2719c-20b6-48f6-9592-f197e3e78a67 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9" returned: 0 in 1.140s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:17 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 is being set with open permissions: ugo+rw Jul 06 15:42:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:17 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 Jul 06 15:42:17 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Flow 'volume_create_manager' (c735933e-e14f-4af1-a447-5f32758e546e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25b07d4-5ec6-4927-bf1f-734b8172542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25b07d4-5ec6-4927-bf1f-734b8172542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c51243f-f59f-4187-ae9e-10450a68b8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c1da20c9e4caa9e86d970c94c75c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:19Z,use_quota=True,user_id='b655f6d239214c3ab9fb6fb6bad4e87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb72c9c4-084c-401e-995b-fc729fc7fa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb72c9c4-084c-401e-995b-fc729fc7fa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dbc755-5cb4-4b3e-a492-1641d639306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55dbc755-5cb4-4b3e-a492-1641d639306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c51243f-f59f-4187-ae9e-10450a68b8cb', 'volume_name': 'volume-3c51243f-f59f-4187-ae9e-10450a68b8cb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f492c6-e818-46e8-810e-1de8361b46c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:18 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f492c6-e818-46e8-810e-1de8361b46c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c2b727-7019-4e8e-b12f-cd6c3c0c58a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:18 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Volume 3c51243f-f59f-4187-ae9e-10450a68b8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c51243f-f59f-4187-ae9e-10450a68b8cb', 'volume_size': 1} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9" returned: 0 in 1.037s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:19 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info Jul 06 15:42:19 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:19 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info" returned: 0 in 0.787s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:19 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info is being set with open permissions: ugo+rw Jul 06 15:42:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:19 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info Jul 06 15:42:19 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:20 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.info" returned: 0 in 0.787s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.782s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.645s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c51243f-f59f-4187-ae9e-10450a68b8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c1da20c9e4caa9e86d970c94c75c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:19Z,use_quota=True,user_id='b655f6d239214c3ab9fb6fb6bad4e87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Creating volume 3c51243f-f59f-4187-ae9e-10450a68b8cb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:42:20 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:42:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:20 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb 1073741824 Jul 06 15:42:20 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a31b8729-57e9-40f9-abbf-b4527271fb6b tempest-TestStampPattern-470785233 None] Create snapshot completed successfully Jul 06 15:42:21 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb 1073741824" returned: 0 in 1.305s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:22 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb Jul 06 15:42:22 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:22 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb" returned: 0 in 0.870s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1c2b727-7019-4e8e-b12f-cd6c3c0c58a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c51243f-f59f-4187-ae9e-10450a68b8cb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba13458c-e0f3-465d-a48e-c605f226fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:22 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Volume volume-3c51243f-f59f-4187-ae9e-10450a68b8cb (3c51243f-f59f-4187-ae9e-10450a68b8cb): created successfully Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba13458c-e0f3-465d-a48e-c605f226fc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Flow 'volume_create_manager' (c735933e-e14f-4af1-a447-5f32758e546e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e53171e4-cb48-4f8a-a110-0c41173696b0 tempest-CinderUnicodeTest-413276841 None] Created volume successfully. Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Flow 'volume_create_manager' (c2a2fc9d-6dd2-4a2e-9d1f-02500c4568c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d691d07-10bb-49fa-b007-274ca7bd6fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d691d07-10bb-49fa-b007-274ca7bd6fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2132475974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b706ab13-348f-447d-92ba-bc66761e7992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c1da20c9e4caa9e86d970c94c75c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:24Z,use_quota=True,user_id='b655f6d239214c3ab9fb6fb6bad4e87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43857fb5-84be-4cd4-b357-b62cf1597523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43857fb5-84be-4cd4-b357-b62cf1597523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91dcbe4-5e1a-482d-bdf1-4f5f572190a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91dcbe4-5e1a-482d-bdf1-4f5f572190a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b706ab13-348f-447d-92ba-bc66761e7992', 'volume_name': 'volume-b706ab13-348f-447d-92ba-bc66761e7992', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b567df14-d741-42d9-b59b-f263339f20ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b567df14-d741-42d9-b59b-f263339f20ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee82992-8c8c-40d3-8785-c15daf5e7f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Volume b706ab13-348f-447d-92ba-bc66761e7992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b706ab13-348f-447d-92ba-bc66761e7992', 'volume_size': 1} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2132475974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b706ab13-348f-447d-92ba-bc66761e7992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c1da20c9e4caa9e86d970c94c75c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:24Z,use_quota=True,user_id='b655f6d239214c3ab9fb6fb6bad4e87a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Creating volume b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:42:23 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:42:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:23 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 1073741824 Jul 06 15:42:23 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:24 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 1073741824" returned: 0 in 1.007s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:24 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 Jul 06 15:42:24 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:25 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992" returned: 0 in 0.699s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ee82992-8c8c-40d3-8785-c15daf5e7f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b706ab13-348f-447d-92ba-bc66761e7992', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e990c7-37cc-4b3d-8b55-774d43edfc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Volume volume-b706ab13-348f-447d-92ba-bc66761e7992 (b706ab13-348f-447d-92ba-bc66761e7992): created successfully Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e990c7-37cc-4b3d-8b55-774d43edfc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Flow 'volume_create_manager' (c2a2fc9d-6dd2-4a2e-9d1f-02500c4568c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-66e2de03-dfd4-4fcc-82cc-55551558ed95 tempest-CinderUnicodeTest-413276841 None] Created volume successfully. Jul 06 15:42:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Creating offline snapshot dd24b3b0-9143-44b3-b296-2beab449f6b6 of volume b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:42:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[498936c5-c2e8-4b45-af14-7a47a7e3ca69]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:26 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 Jul 06 15:42:26 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:27 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992" returned: 0 in 0.941s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:27 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 1G Jul 06 15:42:27 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:28 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 1G" returned: 0 in 1.396s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b706ab13-348f-447d-92ba-bc66761e7992 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:28 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b706ab13-348f-447d-92ba-bc66761e7992 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 Jul 06 15:42:28 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:29 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b706ab13-348f-447d-92ba-bc66761e7992 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6" returned: 0 in 1.186s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:29 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 is being set with open permissions: ugo+rw Jul 06 15:42:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:29 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 Jul 06 15:42:29 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:30 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6" returned: 0 in 1.011s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:30 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info Jul 06 15:42:30 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:32 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info" returned: 0 in 1.243s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:32 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info is being set with open permissions: ugo+rw Jul 06 15:42:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:32 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info Jul 06 15:42:32 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:33 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.info" returned: 0 in 0.845s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.825s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c7eafd19-ea7b-480f-b644-8983a27e1dc1 tempest-CinderUnicodeTest-413276841 None] Create snapshot completed successfully Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-dd24b3b0-9143-44b3-b296-2beab449f6b6-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-dd24b3b0-9143-44b3-b296-2beab449f6b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-quobyte-b706ab13-348f-447d-92ba-bc66761e7992" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-b706ab13-348f-447d-92ba-bc66761e7992" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-quobyte-dd24b3b0-9143-44b3-b296-2beab449f6b6" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-dd24b3b0-9143-44b3-b296-2beab449f6b6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Deleting offline snapshot dd24b3b0-9143-44b3-b296-2beab449f6b6 of volume b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] snapshot_file for this snap is: volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[db379d55-b346-43c1-98d3-e90ebaf3dc2d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:42:34 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 Jul 06 15:42:34 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Flow 'volume_create_manager' (a2d7e012-5484-48e1-8495-5e4dd8fbf71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2918e1a4-16de-4633-b7f0-e69f6286b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2918e1a4-16de-4633-b7f0-e69f6286b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-259297695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25621a14-d335-44cc-842d-157e3bfe59ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76379f98a5744843bb6eb2a4d61300de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb4d7151-c7ac-4efa-acbb-f39084ddfea9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:42:34Z,use_quota=True,user_id='6bfb848f304f4fcfadee2c2298985989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35a408f-c737-4266-a1c9-9b3d160e417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35a408f-c737-4266-a1c9-9b3d160e417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97665fe-4fa3-459e-aff5-d5171bf50e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97665fe-4fa3-459e-aff5-d5171bf50e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '25621a14-d335-44cc-842d-157e3bfe59ac', 'volume_name': 'volume-25621a14-d335-44cc-842d-157e3bfe59ac', 'volume_size': 1, 'snapshot_id': 'fb4d7151-c7ac-4efa-acbb-f39084ddfea9'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b767e0-74e4-41aa-8816-7c05da62e779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b767e0-74e4-41aa-8816-7c05da62e779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74814be9-25c7-4934-9336-cadcd490e650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:34 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Volume 25621a14-d335-44cc-842d-157e3bfe59ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-25621a14-d335-44cc-842d-157e3bfe59ac', 'volume_size': 1, 'snapshot_id': 'fb4d7151-c7ac-4efa-acbb-f39084ddfea9'} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-quobyte-fb4d7151-c7ac-4efa-acbb-f39084ddfea9-25621a14-d335-44cc-842d-157e3bfe59ac" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-fb4d7151-c7ac-4efa-acbb-f39084ddfea9-25621a14-d335-44cc-842d-157e3bfe59ac" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Creating volume 25621a14-d335-44cc-842d-157e3bfe59ac from snapshot fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-quobyte-25621a14-d335-44cc-842d-157e3bfe59ac" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-25621a14-d335-44cc-842d-157e3bfe59ac" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] snapshot: fb4d7151-c7ac-4efa-acbb-f39084ddfea9, volume: 25621a14-d335-44cc-842d-157e3bfe59ac, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded32e5e-b54b-4fbf-b042-bfdf60440b7a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:34 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 Jul 06 15:42:34 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:35 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6" returned: 0 in 1.766s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b706ab13-348f-447d-92ba-bc66761e7992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4c6515-7e80-44e6-9466-5b43d4581bfe]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:35 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9" returned: 0 in 1.275s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe2719c-20b6-48f6-9592-f197e3e78a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2378d8-5842-4b0e-9f77-73046f427b5c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:35 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 Jul 06 15:42:35 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:35 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:42:35 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:37 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992" returned: 0 in 1.503s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:37 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 Jul 06 15:42:37 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:37 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 1.587s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:37 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:42:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:37 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac Jul 06 15:42:37 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:38 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6" returned: 0 in 1.234s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:38 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6 Jul 06 15:42:38 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:39 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992.dd24b3b0-9143-44b3-b296-2beab449f6b6" returned: 0 in 1.624s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-dd24b3b0-9143-44b3-b296-2beab449f6b6" released by "_delete_snapshot" :: held 6.419s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-b706ab13-348f-447d-92ba-bc66761e7992" released by "delete_snapshot" :: held 6.467s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:40 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Created reservations ['5329d4ab-e59d-4a38-a859-71100a26d7d8', 'c13e1356-3e2f-4b4b-b649-37dac43f6eea', '1b18e0c1-aba4-46f1-981d-013157c29ec6', 'c99f622e-36e7-4ee4-848c-2758414aafa9'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Delete snapshot completed successfully. Jul 06 15:42:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f92803b4-5478-4774-8def-b60cb805a6a9 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-dd24b3b0-9143-44b3-b296-2beab449f6b6-delete_snapshot" released by "delete_snapshot" :: held 6.833s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-b706ab13-348f-447d-92ba-bc66761e7992-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-b706ab13-348f-447d-92ba-bc66761e7992-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=82,cinder:UPDATE=72,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=82,cinder:SELECT=68,cinder:DELETE=10,cinder:INSERT=18 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-quobyte-b706ab13-348f-447d-92ba-bc66761e7992" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-b706ab13-348f-447d-92ba-bc66761e7992" acquired by "delete_volume" :: waited 0.053s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0494b1e3-0035-451a-b4a4-a212e8ca10b2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:42 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 Jul 06 15:42:42 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:43 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992" returned: 0 in 1.937s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:43 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992 Jul 06 15:42:43 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:45 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac" returned: 0 in 7.820s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[73da86d4-b65f-4616-b9ad-b4cf45a4869d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:45 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b706ab13-348f-447d-92ba-bc66761e7992" returned: 0 in 1.366s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-b706ab13-348f-447d-92ba-bc66761e7992" released by "delete_volume" :: held 3.470s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:45 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:42:45 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Created reservations ['46c7c0c9-a053-4369-8d86-35ce02f67e77', '3e1c675b-a7db-43f4-aa13-1f3a019b5a6b', 'b9ec4a14-5bcd-4577-8982-6052e7662a10', '269852b1-f646-42a0-86ad-43f5c4ca6c85'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:45 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:42:45 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-3c51243f-f59f-4187-ae9e-10450a68b8cb-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:46 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.063s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Deleted volume successfully. Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-3c51243f-f59f-4187-ae9e-10450a68b8cb-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9e53be26-b4f0-4797-acab-95bb18f25184 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-b706ab13-348f-447d-92ba-bc66761e7992-delete_volume" released by "delete_volume" :: held 5.132s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "cinder-quobyte-3c51243f-f59f-4187-ae9e-10450a68b8cb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-3c51243f-f59f-4187-ae9e-10450a68b8cb" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0549d57c-0f18-44dc-a2c3-d8f7828e8806]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:46 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 1.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:42:46 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Converted 1024.00 MB image at 130.93 MB/s Jul 06 15:42:46 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac is being set with open permissions: ugo+rw Jul 06 15:42:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:46 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac Jul 06 15:42:46 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:47 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb Jul 06 15:42:47 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:47 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac" returned: 0 in 0.876s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:47 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-25621a14-d335-44cc-842d-157e3bfe59ac" released by "_copy_volume_from_snapshot" :: held 13.524s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb" returned: 0 in 0.980s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-fb4d7151-c7ac-4efa-acbb-f39084ddfea9-25621a14-d335-44cc-842d-157e3bfe59ac" released by "_create_volume_from_snapshot" :: held 13.574s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.597s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:47 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb Jul 06 15:42:47 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74814be9-25c7-4934-9336-cadcd490e650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25621a14-d335-44cc-842d-157e3bfe59ac', 'volume_size': 1, 'snapshot_id': 'fb4d7151-c7ac-4efa-acbb-f39084ddfea9'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e4cf5f-048b-4938-a3f9-bc4a5f9f301b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:42:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Volume volume-25621a14-d335-44cc-842d-157e3bfe59ac (25621a14-d335-44cc-842d-157e3bfe59ac): created successfully Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e4cf5f-048b-4938-a3f9-bc4a5f9f301b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:42:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Flow 'volume_create_manager' (a2d7e012-5484-48e1-8495-5e4dd8fbf71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:42:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-32fb6b47-6964-4ca9-9a03-46a9e56f5f06 tempest-TestStampPattern-470785233 None] Created volume successfully. Jul 06 15:42:48 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c51243f-f59f-4187-ae9e-10450a68b8cb" returned: 0 in 0.885s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-quobyte-3c51243f-f59f-4187-ae9e-10450a68b8cb" released by "delete_volume" :: held 1.916s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Created reservations ['69b790fc-b078-4036-8428-3b754386f5ae', '6db281e0-71ae-48cb-b464-40a1f0514d82', 'b1341b76-55da-4aa1-ba51-1e8a8d4b7c78', '5d309c82-05f3-4cac-a491-e2e8557f1b94'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:42:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:42:48 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:42:48 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:42:49 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 06 15:42:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.789s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:42:49 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:42:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Deleted volume successfully. Jul 06 15:42:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-af80b284-19c4-41eb-802e-799adfb98057 tempest-CinderUnicodeTest-413276841 None] Lock "cinder-3c51243f-f59f-4187-ae9e-10450a68b8cb-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:42:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-1a347c9d-236b-47a3-a795-909c8973b133 req-b132ac0d-ccfc-437f-8d90-6c18a0234d9f tempest-TestMinimumBasicScenario-2137637497 None] Terminate volume connection completed successfully. Jul 06 15:42:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-1a347c9d-236b-47a3-a795-909c8973b133 req-b132ac0d-ccfc-437f-8d90-6c18a0234d9f tempest-TestMinimumBasicScenario-2137637497 None] Deleting attachment 1cb85d05-0933-4d61-84dd-6ad93434be63. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:43:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Acquiring lock "cinder-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Lock "cinder-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Acquiring lock "cinder-quobyte-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Lock "cinder-quobyte-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:00 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcba0fc-baf8-4887-b9ef-93e4f454e41a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:00 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d Jul 06 15:43:00 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:02 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" returned: 0 in 1.870s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:02 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d Jul 06 15:43:02 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:03 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" returned: 0 in 1.447s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Lock "cinder-quobyte-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d" released by "delete_volume" :: held 3.414s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:03 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Created reservations ['c7f2f13c-a550-493d-ae26-7bca06d6a5e9', 'a50d0935-d5f2-42fd-a6c4-b727c24322d8', 'a4c7fae4-2a9f-4f3e-b586-0f17e0c26118', '2bae53ce-93d3-46ce-a9a5-dd98a7cbb17c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:43:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:04 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:43:04 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:05 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.287s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:05 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:43:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Deleted volume successfully. Jul 06 15:43:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6cc3a13b-ea8d-47c5-9555-1587b070837a tempest-TestMinimumBasicScenario-2137637497 None] Lock "cinder-a4d6aeb1-ccc4-4782-b614-0df1b76bc47d-delete_volume" released by "delete_volume" :: held 5.085s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:06 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:43:06 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:09 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 2.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:09 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:43:09 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:43:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:43:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:43:14 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:43:15 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=3 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Flow 'volume_create_manager' (c6232989-9117-49f6-bcfb-4cd520ab7157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e15fda-0dee-46c9-820c-1d95c94443f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e15fda-0dee-46c9-820c-1d95c94443f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-28267045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810756c5-508c-434c-b5d5-df68f9e3f309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e7ae4d827942f58d95cfe343a8ec46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:28Z,use_quota=True,user_id='b6d3a34c772f4e10bcfa8aeed9705499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2a18c3-87e8-4d62-a184-847aa99ac49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2a18c3-87e8-4d62-a184-847aa99ac49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4d6635-7312-48a6-9738-33bf493af929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e4d6635-7312-48a6-9738-33bf493af929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810756c5-508c-434c-b5d5-df68f9e3f309', 'volume_name': 'volume-810756c5-508c-434c-b5d5-df68f9e3f309', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6484ace6-96f5-4225-b1b0-d773d5a5bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6484ace6-96f5-4225-b1b0-d773d5a5bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321f4e63-3eb1-4027-a509-21a5666ec53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Volume 810756c5-508c-434c-b5d5-df68f9e3f309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810756c5-508c-434c-b5d5-df68f9e3f309', 'volume_size': 1} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-28267045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810756c5-508c-434c-b5d5-df68f9e3f309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e7ae4d827942f58d95cfe343a8ec46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:28Z,use_quota=True,user_id='b6d3a34c772f4e10bcfa8aeed9705499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Creating volume 810756c5-508c-434c-b5d5-df68f9e3f309 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:43:28 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:43:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:28 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 1073741824 Jul 06 15:43:28 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:29 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 1073741824" returned: 0 in 1.412s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:30 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 Jul 06 15:43:30 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:30 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309" returned: 0 in 0.702s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.298s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321f4e63-3eb1-4027-a509-21a5666ec53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810756c5-508c-434c-b5d5-df68f9e3f309', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e89ce22-e02e-4852-ae81-d1cc943fbc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7877ec1-744a-4de8-8fc5-107bce3ea150]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Volume volume-810756c5-508c-434c-b5d5-df68f9e3f309 (810756c5-508c-434c-b5d5-df68f9e3f309): created successfully Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e89ce22-e02e-4852-ae81-d1cc943fbc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Flow 'volume_create_manager' (c6232989-9117-49f6-bcfb-4cd520ab7157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e5ac1279-f306-4f14-b393-31ed8f24c1cf tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Created volume successfully. Jul 06 15:43:30 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac Jul 06 15:43:30 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Flow 'volume_create_manager' (ed1f77b6-fecb-4c12-a46e-6f5537e5b4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d637ee05-0b07-42f3-bba8-71f03f70e356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d637ee05-0b07-42f3-bba8-71f03f70e356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-561930947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c988c527-5180-4192-9b42-b13980883dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d044e40c324715a99d7fd82f8ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:31Z,use_quota=True,user_id='ca7d45467f27435aa46d119a5bc6be01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324edaa9-82d2-4769-9f6d-6966ba160e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324edaa9-82d2-4769-9f6d-6966ba160e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36ec75e-3f91-45a8-b6b7-6bb57714d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36ec75e-3f91-45a8-b6b7-6bb57714d31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c988c527-5180-4192-9b42-b13980883dad', 'volume_name': 'volume-c988c527-5180-4192-9b42-b13980883dad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19a2d05-af46-4bd1-8b4b-295fa89d4dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19a2d05-af46-4bd1-8b4b-295fa89d4dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39cf29-aab3-45f0-a4a8-20ee8e034519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Volume c988c527-5180-4192-9b42-b13980883dad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c988c527-5180-4192-9b42-b13980883dad', 'volume_size': 1} Jul 06 15:43:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:31 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac" returned: 0 in 0.820s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-561930947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c988c527-5180-4192-9b42-b13980883dad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d044e40c324715a99d7fd82f8ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:31Z,use_quota=True,user_id='ca7d45467f27435aa46d119a5bc6be01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Creating volume c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:43:31 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:31 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad 1073741824 Jul 06 15:43:31 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-25621a14-d335-44cc-842d-157e3bfe59ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9520cbe-e190-410d-aa43-841f066ef963', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:43:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-6582d2d3-e594-469d-954b-123080c862ac req-73e2a68e-5259-45c0-9a84-44a45fa62208 tempest-TestStampPattern-470785233 None] attachment_update completed successfully. Jul 06 15:43:32 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad 1073741824" returned: 0 in 0.927s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:32 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:32 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:33 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 0.702s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39cf29-aab3-45f0-a4a8-20ee8e034519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c988c527-5180-4192-9b42-b13980883dad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5aa162-2fd5-4b7e-a514-f70e812a5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:33 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Volume volume-c988c527-5180-4192-9b42-b13980883dad (c988c527-5180-4192-9b42-b13980883dad): created successfully Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5aa162-2fd5-4b7e-a514-f70e812a5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Flow 'volume_create_manager' (ed1f77b6-fecb-4c12-a46e-6f5537e5b4ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1ceba1be-cd79-424d-a11e-2c501f200644 tempest-SnapshotDependencyTests-593531582 None] Created volume successfully. Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Flow 'volume_create_manager' (731c93cd-5ebe-4a56-96bf-e85dbf7b1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fe2812-dd76-416d-887e-bf3eddea07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fe2812-dd76-416d-887e-bf3eddea07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d3ebf5-0862-4c2a-9a96-85518f4e5e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03da45260444705a36d04a2d66a01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:34Z,use_quota=True,user_id='0fe356e176c540ed8a6642691ec59528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2970bf1-86ee-434b-a6eb-e078db04eba0),volume_type_id=b2970bf1-86ee-434b-a6eb-e078db04eba0)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bef0159-3980-423b-89bd-d25c4ea34af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bef0159-3980-423b-89bd-d25c4ea34af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c7dae3-a98f-4d58-b16f-fe8612d09213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Creating offline snapshot a2746e68-4acb-472e-8675-a8383e97e835 of volume c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[49803d90-2108-4926-b546-90655b935f40]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c7dae3-a98f-4d58-b16f-fe8612d09213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53d3ebf5-0862-4c2a-9a96-85518f4e5e99', 'volume_name': 'volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99', 'volume_size': 1, 'image_id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b205f09-5a79-485c-9551-f98ba177c26d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0ec4706fa8e6f6088f566738e9ac68b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c03da45260444705a36d04a2d66a01cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49dfafefd1d35548af5498b27fc8d743c661fb4c779635e15797d78df161e1596db624d0c6e09e9256348fd39f92457cfdd8ed597403f6f10e2839a8caeff7f2', 'id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'created_at': datetime.datetime(2026, 7, 6, 13, 43, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 43, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b205f09-5a79-485c-9551-f98ba177c26d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd79e1a-fde8-4544-b002-669021e79c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd79e1a-fde8-4544-b002-669021e79c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5ece9a-f625-4162-8132-174448becadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:34 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Volume 53d3ebf5-0862-4c2a-9a96-85518f4e5e99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99', 'volume_size': 1, 'image_id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b205f09-5a79-485c-9551-f98ba177c26d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0ec4706fa8e6f6088f566738e9ac68b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c03da45260444705a36d04a2d66a01cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49dfafefd1d35548af5498b27fc8d743c661fb4c779635e15797d78df161e1596db624d0c6e09e9256348fd39f92457cfdd8ed597403f6f10e2839a8caeff7f2', 'id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'created_at': datetime.datetime(2026, 7, 6, 13, 43, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 43, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b205f09-5a79-485c-9551-f98ba177c26d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Trying to clone 53d3ebf5-0862-4c2a-9a96-85518f4e5e99 from image 3b205f09-5a79-485c-9551-f98ba177c26d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b205f09-5a79-485c-9551-f98ba177c26d', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:43:34 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:34 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:43:34 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e7274a-aa4e-49d1-9563-72361ebfbbf6]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:35 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD Jul 06 15:43:35 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:35 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:35 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 1G Jul 06 15:43:35 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:35 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:35 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD Jul 06 15:43:35 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:36 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 1G" returned: 0 in 0.846s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c988c527-5180-4192-9b42-b13980883dad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:36 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c988c527-5180-4192-9b42-b13980883dad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 Jul 06 15:43:36 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:36 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Temporary image 3b205f09-5a79-485c-9551-f98ba177c26d is fetched for user 0fe356e176c540ed8a6642691ec59528. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d134227-c1d0-4d86-800d-4bf3e6276f6f]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:36 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD Jul 06 15:43:36 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:37 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c988c527-5180-4192-9b42-b13980883dad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835" returned: 0 in 0.681s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:37 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 is being set with open permissions: ugo+rw Jul 06 15:43:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:37 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 Jul 06 15:43:37 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:37 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:37 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD Jul 06 15:43:37 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:37 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835" returned: 0 in 0.772s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:37 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info Jul 06 15:43:37 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:38 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD" returned: 1 in 0.775s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:38 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info" returned: 0 in 0.688s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:38 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info is being set with open permissions: ugo+rw Jul 06 15:43:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:38 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info Jul 06 15:43:38 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-c77176c2-6172-4de1-bd9f-caf3e193b491 req-9340fc9a-c0cb-4768-8b5f-23e6a1512d14 tempest-TestStampPattern-470785233 None] Terminate volume connection completed successfully. Jul 06 15:43:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-c77176c2-6172-4de1-bd9f-caf3e193b491 req-9340fc9a-c0cb-4768-8b5f-23e6a1512d14 tempest-TestStampPattern-470785233 None] Deleting attachment f9520cbe-e190-410d-aa43-841f066ef963. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:43:39 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.info" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.666s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.046s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[836304de-fadd-4e89-a740-1d0d48931cfb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f17c9b7b-7d08-495e-bd31-4c5ab5de2e0f tempest-SnapshotDependencyTests-593531582 None] Create snapshot completed successfully Jul 06 15:43:39 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 Jul 06 15:43:39 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:40 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309" returned: 0 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.793s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d3ebf5-0862-4c2a-9a96-85518f4e5e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c03da45260444705a36d04a2d66a01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:34Z,use_quota=True,user_id='0fe356e176c540ed8a6642691ec59528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b2970bf1-86ee-434b-a6eb-e078db04eba0),volume_type_id=b2970bf1-86ee-434b-a6eb-e078db04eba0)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Creating volume 53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:43:40 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:40 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 1073741824 Jul 06 15:43:40 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f', 'name': 'volume-810756c5-508c-434c-b5d5-df68f9e3f309', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61da21eb-810e-4a79-bea9-dd4badaae61a', 'enforce_multipath': True} {{(pid=86191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 15:43:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-e38fff3d-060a-4f23-a70c-e774343cd6cc req-1965373b-ef32-4ab7-a3e8-dea3d217b828 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] attachment_update completed successfully. Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Flow 'volume_create_manager' (993a5677-e618-480d-a741-7358d9393d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8bea01-47e0-406e-a1a3-10af8e539a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8bea01-47e0-406e-a1a3-10af8e539a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee0ac2d-3230-4934-9144-dbd12584e5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d044e40c324715a99d7fd82f8ad53e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2746e68-4acb-472e-8675-a8383e97e835,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:43:40Z,use_quota=True,user_id='ca7d45467f27435aa46d119a5bc6be01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09313050-8f59-4f04-9f03-a5dcb5560480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09313050-8f59-4f04-9f03-a5dcb5560480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea69d2c-0dec-45b6-b220-b4fb24ebe529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea69d2c-0dec-45b6-b220-b4fb24ebe529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4ee0ac2d-3230-4934-9144-dbd12584e5d6', 'volume_name': 'volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6', 'volume_size': 1, 'snapshot_id': 'a2746e68-4acb-472e-8675-a8383e97e835'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad16f2c-1419-4d7e-a09d-53f0ca120f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad16f2c-1419-4d7e-a09d-53f0ca120f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66cfd5c-7c73-46f0-ac8d-00885b51fcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Volume 4ee0ac2d-3230-4934-9144-dbd12584e5d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6', 'volume_size': 1, 'snapshot_id': 'a2746e68-4acb-472e-8675-a8383e97e835'} Jul 06 15:43:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:41 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 1073741824" returned: 0 in 0.933s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:41 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:41 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:41 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 0 in 0.821s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.305s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-quobyte-a2746e68-4acb-472e-8675-a8383e97e835-4ee0ac2d-3230-4934-9144-dbd12584e5d6" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-a2746e68-4acb-472e-8675-a8383e97e835-4ee0ac2d-3230-4934-9144-dbd12584e5d6" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Creating volume 4ee0ac2d-3230-4934-9144-dbd12584e5d6 from snapshot a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-quobyte-4ee0ac2d-3230-4934-9144-dbd12584e5d6" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Attempting download of 3b205f09-5a79-485c-9551-f98ba177c26d ((None, [{'url': 'file:///opt/stack/data/glance/images/3b205f09-5a79-485c-9551-f98ba177c26d', 'metadata': {}}])) to volume 53d3ebf5-0862-4c2a-9a96-85518f4e5e99. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-4ee0ac2d-3230-4934-9144-dbd12584e5d6" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] snapshot: a2746e68-4acb-472e-8675-a8383e97e835, volume: 4ee0ac2d-3230-4934-9144-dbd12584e5d6, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[35987068-4029-4788-9645-d38735e3f871]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5c0299-63bf-4b09-ab7f-963ca5e74886]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:42 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t Jul 06 15:43:42 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:42 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 Jul 06 15:43:42 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:42 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t" returned: 0 in 0.877s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:43 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835" returned: 0 in 0.970s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c988c527-5180-4192-9b42-b13980883dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[55978bb5-bd2e-4d1c-85bd-7e6ed3fe7496]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:43 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t Jul 06 15:43:43 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:43 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:43 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:43 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t" returned: 1 in 0.816s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b205f09-5a79-485c-9551-f98ba177c26d_fkvq394t' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[31008a44-00f7-4b0b-a248-869285da5be3]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:43 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD Jul 06 15:43:43 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:44 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 0.997s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:44 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:43:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:44 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 Jul 06 15:43:44 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:44 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD" returned: 0 in 0.946s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:44 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD Jul 06 15:43:44 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:46 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD" returned: 1 in 1.445s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:46 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] 3b205f09-5a79-485c-9551-f98ba177c26d was raw, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:43:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:46 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:46 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [req-ee4f179d-f9c9-4316-b720-662b44d87fa2 req-0641ea5e-cfb0-480a-895d-f2ca20e46ee4 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Terminate volume connection completed successfully. Jul 06 15:43:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [req-ee4f179d-f9c9-4316-b720-662b44d87fa2 req-0641ea5e-cfb0-480a-895d-f2ca20e46ee4 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Deleting attachment 61da21eb-810e-4a79-bea9-dd4badaae61a. {{(pid=86191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 15:43:48 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 0 in 2.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:48 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b205f09-5a79-485c-9551-f98ba177c26d_b3kceovvdevstack@QuobyteHD, size 0.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:43:48 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:43:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:49 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 1G Jul 06 15:43:49 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-25621a14-d335-44cc-842d-157e3bfe59ac-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Lock "cinder-25621a14-d335-44cc-842d-157e3bfe59ac-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-quobyte-25621a14-d335-44cc-842d-157e3bfe59ac" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-25621a14-d335-44cc-842d-157e3bfe59ac" acquired by "delete_volume" :: waited 0.068s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[02367c90-76c0-4457-88d0-571eacce964e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:50 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 1G" returned: 0 in 1.640s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:50 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac Jul 06 15:43:50 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cfbff8-a325-4bc4-81cc-d8045bd07045]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:50 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6" returned: 0 in 6.636s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee471744-f802-456b-93b3-d24747f70f77]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:50 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:50 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Acquiring lock "cinder-810756c5-508c-434c-b5d5-df68f9e3f309-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "cinder-810756c5-508c-434c-b5d5-df68f9e3f309-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:50 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:50 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Acquiring lock "cinder-quobyte-810756c5-508c-434c-b5d5-df68f9e3f309" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "cinder-quobyte-810756c5-508c-434c-b5d5-df68f9e3f309" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c58752b-d083-4e91-b9a7-062a34b91c91]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:51 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 Jul 06 15:43:51 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:51 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac" returned: 0 in 0.944s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:51 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac Jul 06 15:43:51 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:51 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 0 in 0.881s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:51 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:51 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:51 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309" returned: 0 in 0.869s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:51 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309 Jul 06 15:43:51 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:51 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 1.159s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:43:51 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Converted 1024.00 MB image at 154.29 MB/s Jul 06 15:43:51 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 is being set with open permissions: ugo+rw Jul 06 15:43:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:51 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 Jul 06 15:43:51 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:52 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-25621a14-d335-44cc-842d-157e3bfe59ac" returned: 0 in 0.752s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-25621a14-d335-44cc-842d-157e3bfe59ac" released by "delete_volume" :: held 1.796s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Created reservations ['948e3dbe-f6fb-4598-b5d9-addbeb6fad13', '147bd7dd-d996-4e0b-b885-9d3911e7b09f', 'ab6e19ef-d8f0-49d6-89c3-cae18966c596', '18f8dc39-5830-4b1f-ba35-d46d52ea4d6b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:52 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:43:52 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:52 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 1 in 0.864s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Downloaded image 3b205f09-5a79-485c-9551-f98ba177c26d ((None, [{'url': 'file:///opt/stack/data/glance/images/3b205f09-5a79-485c-9551-f98ba177c26d', 'metadata': {}}])) to volume 53d3ebf5-0862-4c2a-9a96-85518f4e5e99 successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Temporary image 3b205f09-5a79-485c-9551-f98ba177c26d for user 0fe356e176c540ed8a6642691ec59528 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Marking volume 53d3ebf5-0862-4c2a-9a96-85518f4e5e99 as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Copying metadata from image 3b205f09-5a79-485c-9551-f98ba177c26d to 53d3ebf5-0862-4c2a-9a96-85518f4e5e99. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Creating volume glance metadata for volume 53d3ebf5-0862-4c2a-9a96-85518f4e5e99 backed by image 3b205f09-5a79-485c-9551-f98ba177c26d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f0ec4706fa8e6f6088f566738e9ac68b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5ece9a-f625-4162-8132-174448becadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99', 'volume_size': 1, 'image_id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b205f09-5a79-485c-9551-f98ba177c26d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f0ec4706fa8e6f6088f566738e9ac68b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c03da45260444705a36d04a2d66a01cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49dfafefd1d35548af5498b27fc8d743c661fb4c779635e15797d78df161e1596db624d0c6e09e9256348fd39f92457cfdd8ed597403f6f10e2839a8caeff7f2', 'id': '3b205f09-5a79-485c-9551-f98ba177c26d', 'created_at': datetime.datetime(2026, 7, 6, 13, 43, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 43, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b205f09-5a79-485c-9551-f98ba177c26d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3682ddce-90c2-4c5f-aa32-fb538e93951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Volume volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 (53d3ebf5-0862-4c2a-9a96-85518f4e5e99): created successfully Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3682ddce-90c2-4c5f-aa32-fb538e93951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Flow 'volume_create_manager' (731c93cd-5ebe-4a56-96bf-e85dbf7b1e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-232967f0-fabd-4f56-a5ed-b94444b40d00 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Created volume successfully. Jul 06 15:43:52 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6" returned: 0 in 0.777s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-4ee0ac2d-3230-4934-9144-dbd12584e5d6" released by "_copy_volume_from_snapshot" :: held 10.680s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:52 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-810756c5-508c-434c-b5d5-df68f9e3f309" returned: 0 in 0.863s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-a2746e68-4acb-472e-8675-a8383e97e835-4ee0ac2d-3230-4934-9144-dbd12584e5d6" released by "_create_volume_from_snapshot" :: held 10.730s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.770s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "cinder-quobyte-810756c5-508c-434c-b5d5-df68f9e3f309" released by "delete_volume" :: held 1.803s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66cfd5c-7c73-46f0-ac8d-00885b51fcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6', 'volume_size': 1, 'snapshot_id': 'a2746e68-4acb-472e-8675-a8383e97e835'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353f07c7-89d6-4529-91ab-6c98874e0b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:43:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Volume volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 (4ee0ac2d-3230-4934-9144-dbd12584e5d6): created successfully Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353f07c7-89d6-4529-91ab-6c98874e0b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Flow 'volume_create_manager' (993a5677-e618-480d-a741-7358d9393d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:43:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6297d407-0447-47be-8e9f-f0abffa330f3 tempest-SnapshotDependencyTests-593531582 None] Created volume successfully. Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Created reservations ['37d52ff4-9f63-41dc-841f-5d4ac296aa63', '4d7859a5-df2b-4b97-ae00-74382ee4f56b', '85008472-c5bd-4c6e-9af0-537463fd4a84', '249d92eb-ca85-47bc-b466-6083e4f2ab19'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:52 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:43:52 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-fb4d7151-c7ac-4efa-acbb-f39084ddfea9-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Lock "cinder-fb4d7151-c7ac-4efa-acbb-f39084ddfea9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-quobyte-efe2719c-20b6-48f6-9592-f197e3e78a67" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-efe2719c-20b6-48f6-9592-f197e3e78a67" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-quobyte-fb4d7151-c7ac-4efa-acbb-f39084ddfea9" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-fb4d7151-c7ac-4efa-acbb-f39084ddfea9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Deleting offline snapshot fb4d7151-c7ac-4efa-acbb-f39084ddfea9 of volume efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] snapshot_file for this snap is: volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6698d26b-0484-4b03-bc8d-81d95cc5968f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:53 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:43:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Deleted volume successfully. Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-04428521-f30a-48ab-a00a-1a8ed4e0e75a tempest-TestStampPattern-470785233 None] Lock "cinder-25621a14-d335-44cc-842d-157e3bfe59ac-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:53 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 Jul 06 15:43:53 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Acquiring lock "cinder-53d3ebf5-0862-4c2a-9a96-85518f4e5e99-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "cinder-53d3ebf5-0862-4c2a-9a96-85518f4e5e99-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Acquiring lock "cinder-quobyte-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "cinder-quobyte-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d310d395-5932-4c46-b0de-8ba9fecf7983]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:53 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:53 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:43:53 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Deleted volume successfully. Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-bc954b42-511f-4afb-83ff-1c9a0c6a7343 tempest-TestServerVolumeAttachScenarioOldVersion-137407490 None] Lock "cinder-810756c5-508c-434c-b5d5-df68f9e3f309-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-a2746e68-4acb-472e-8675-a8383e97e835-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-a2746e68-4acb-472e-8675-a8383e97e835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-quobyte-c988c527-5180-4192-9b42-b13980883dad" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-c988c527-5180-4192-9b42-b13980883dad" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-quobyte-a2746e68-4acb-472e-8675-a8383e97e835" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:54 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-a2746e68-4acb-472e-8675-a8383e97e835" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Deleting offline snapshot a2746e68-4acb-472e-8675-a8383e97e835 of volume c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] snapshot_file for this snap is: volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9" returned: 0 in 1.010s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efe2719c-20b6-48f6-9592-f197e3e78a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1496c-716e-4f0a-b10e-3fca8f00ccc3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e837bc-5e07-4b9c-bb43-d255959babb3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:54 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 Jul 06 15:43:54 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:54 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:43:54 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:54 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 0 in 0.894s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:54 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:54 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:54 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835" returned: 0 in 0.837s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c988c527-5180-4192-9b42-b13980883dad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[35536833-4df9-4126-8c8b-d2b3e3ec6e5e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:54 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 0.869s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:54 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 Jul 06 15:43:54 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:55 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:55 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:55 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 1 in 1.044s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:43:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:55 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99 Jul 06 15:43:55 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:56 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9" returned: 0 in 1.055s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:56 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 1.083s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:56 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9 Jul 06 15:43:56 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:56 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 Jul 06 15:43:56 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:56 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" returned: 0 in 0.939s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "cinder-quobyte-53d3ebf5-0862-4c2a-9a96-85518f4e5e99" released by "delete_volume" :: held 2.980s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:56 devstack cinder-volume[86191]: WARNING cinder.quota [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:43:56 devstack cinder-volume[86191]: WARNING cinder.quota [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Created reservations ['46cb7938-cab1-4d22-8e5a-d886aad95e65', '46c1e78e-35b1-4452-aad3-fd0ed63850e3', 'aeed4584-0417-4ceb-8ab3-481dec798d7a', '8e7f0801-f669-4584-a572-b3afbc3d8f25'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:56 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:43:56 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:56 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67.fb4d7151-c7ac-4efa-acbb-f39084ddfea9" returned: 0 in 0.934s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:56 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835" returned: 0 in 0.971s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-fb4d7151-c7ac-4efa-acbb-f39084ddfea9" released by "_delete_snapshot" :: held 4.013s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-efe2719c-20b6-48f6-9592-f197e3e78a67" released by "delete_snapshot" :: held 4.050s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:57 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835 Jul 06 15:43:57 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Created reservations ['ddc851d1-5948-4813-8136-2a723aaef4ca', '9876158d-b3f3-4fb3-9c23-52b94d5b05c1', '4e4c04d4-6dd2-4516-8119-921ed3d7039c', '6654bdd0-e797-429f-b3fe-9dffe3467938'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:43:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Delete snapshot completed successfully. Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29c48970-03d1-42cd-af52-786ec97cdc95 tempest-TestStampPattern-470785233 None] Lock "cinder-fb4d7151-c7ac-4efa-acbb-f39084ddfea9-delete_snapshot" released by "delete_snapshot" :: held 4.286s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:57 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.893s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:43:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Deleted volume successfully. Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-553c0cf8-9509-4458-b7f5-ec9d9bb52306 tempest-VolumeAndVolumeTypeFromImageTest-134773162 None] Lock "cinder-53d3ebf5-0862-4c2a-9a96-85518f4e5e99-delete_volume" released by "delete_volume" :: held 4.328s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:57 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad.a2746e68-4acb-472e-8675-a8383e97e835" returned: 0 in 0.844s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-a2746e68-4acb-472e-8675-a8383e97e835" released by "_delete_snapshot" :: held 3.865s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-c988c527-5180-4192-9b42-b13980883dad" released by "delete_snapshot" :: held 3.891s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Created reservations ['a9dfd585-f990-42f9-adb2-9ef03e644027', 'd71e2db6-3895-4d7a-9a2c-e69b2ec1a3c0', 'c20325f0-da1a-4efa-8814-eaed4e2215ab', 'e1e9597d-f108-40c1-9a41-ea22fb0bbabc'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:43:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Delete snapshot completed successfully. Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a84cd64f-fc52-4f43-a047-79582814f5a3 tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-a2746e68-4acb-472e-8675-a8383e97e835-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-c988c527-5180-4192-9b42-b13980883dad-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-c988c527-5180-4192-9b42-b13980883dad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-quobyte-c988c527-5180-4192-9b42-b13980883dad" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-c988c527-5180-4192-9b42-b13980883dad" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a6e0cd-ea18-45ab-9bbc-ea9fbe322d3f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:43:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:58 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:58 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:43:59 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 06 15:43:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 0.992s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:43:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:43:59 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad Jul 06 15:43:59 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:00 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c988c527-5180-4192-9b42-b13980883dad" returned: 0 in 0.982s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-c988c527-5180-4192-9b42-b13980883dad" released by "delete_volume" :: held 2.083s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Created reservations ['80c86040-b720-4405-82ee-e6e3b22abe21', '1370195c-6052-4e36-9980-1dab37ec7f11', '27e5aebe-76ee-449c-b172-71a6ac21796c', 'feefe0f2-82fc-415c-813c-70f56a03bb1e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:00 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:00 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:01 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.883s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Deleted volume successfully. Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1ccf80fd-7fbf-40c8-a3c4-abaae9c0edfb tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-c988c527-5180-4192-9b42-b13980883dad-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-4ee0ac2d-3230-4934-9144-dbd12584e5d6-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-4ee0ac2d-3230-4934-9144-dbd12584e5d6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "cinder-quobyte-4ee0ac2d-3230-4934-9144-dbd12584e5d6" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-4ee0ac2d-3230-4934-9144-dbd12584e5d6" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[471cec1e-dd66-4a61-92f7-d92f45f79360]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:02 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 Jul 06 15:44:02 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:02 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6" returned: 0 in 1.035s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:03 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6 Jul 06 15:44:03 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:03 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4ee0ac2d-3230-4934-9144-dbd12584e5d6" returned: 0 in 0.865s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-quobyte-4ee0ac2d-3230-4934-9144-dbd12584e5d6" released by "delete_volume" :: held 1.953s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Created reservations ['a70cb376-b6f9-448f-a990-b7fddb6d5c98', 'c73da8a7-e499-491b-91ca-220f88d47c30', 'c08eae35-75e3-49a6-be92-99985aa3d0cb', '92df3234-984f-42d8-b4ac-66ddb8cc7eba'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:04 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:04 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:04 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.739s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:04 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Deleted volume successfully. Jul 06 15:44:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5c36c941-b916-4255-a796-af0433aaeb4a tempest-SnapshotDependencyTests-593531582 None] Lock "cinder-4ee0ac2d-3230-4934-9144-dbd12584e5d6-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:06 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:06 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Flow 'volume_create_manager' (4c802473-bf1b-492b-b4cc-fb0c1865037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a0f055-1b0d-4048-8d0f-ed746f4927c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a0f055-1b0d-4048-8d0f-ed746f4927c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9685e2e2-7136-4cea-b677-666cc2a26c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669333dbe6bb44ae92adbecb25ec1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:07Z,use_quota=True,user_id='f2c6d51cf3a6414aa854779bc26663d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0f7f01-34e6-4b3b-a13c-2c31f40dbb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0f7f01-34e6-4b3b-a13c-2c31f40dbb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a0abaf-1c86-43b8-96e4-8ce991e8bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-efe2719c-20b6-48f6-9592-f197e3e78a67-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Lock "cinder-efe2719c-20b6-48f6-9592-f197e3e78a67-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Acquiring lock "cinder-quobyte-efe2719c-20b6-48f6-9592-f197e3e78a67" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-efe2719c-20b6-48f6-9592-f197e3e78a67" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d99681e-c587-4982-9e21-ef41b0742022]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a0abaf-1c86-43b8-96e4-8ce991e8bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9685e2e2-7136-4cea-b677-666cc2a26c27', 'volume_name': 'volume-9685e2e2-7136-4cea-b677-666cc2a26c27', 'volume_size': 1, 'image_id': '77f2e033-c855-4473-bb22-d90e507c549c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77f2e033-c855-4473-bb22-d90e507c549c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7abc372e55425f58cc517f0bdfd10ac3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '669333dbe6bb44ae92adbecb25ec1491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f74e84563c5eb6c7c8df89ee8aade551ecf4071e5d90a48ef3c46dd8b133d76a34c18ec815cea779cad10b535168b9432e23dbe889eb4bd653f6b2b07dfbdef', 'id': '77f2e033-c855-4473-bb22-d90e507c549c', 'created_at': datetime.datetime(2026, 7, 6, 13, 44, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 44, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77f2e033-c855-4473-bb22-d90e507c549c/file', 'properties': {}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb23995-df83-4998-9baa-3191b18ea7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb23995-df83-4998-9baa-3191b18ea7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73dbf74-7502-4784-a52f-6dd53d088c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:07 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Volume 9685e2e2-7136-4cea-b677-666cc2a26c27: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9685e2e2-7136-4cea-b677-666cc2a26c27', 'volume_size': 1, 'image_id': '77f2e033-c855-4473-bb22-d90e507c549c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77f2e033-c855-4473-bb22-d90e507c549c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7abc372e55425f58cc517f0bdfd10ac3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '669333dbe6bb44ae92adbecb25ec1491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f74e84563c5eb6c7c8df89ee8aade551ecf4071e5d90a48ef3c46dd8b133d76a34c18ec815cea779cad10b535168b9432e23dbe889eb4bd653f6b2b07dfbdef', 'id': '77f2e033-c855-4473-bb22-d90e507c549c', 'created_at': datetime.datetime(2026, 7, 6, 13, 44, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 44, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77f2e033-c855-4473-bb22-d90e507c549c/file', 'properties': {}}, 'image_service': } Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Trying to clone 9685e2e2-7136-4cea-b677-666cc2a26c27 from image 77f2e033-c855-4473-bb22-d90e507c549c at location (None, [{'url': 'file:///opt/stack/data/glance/images/77f2e033-c855-4473-bb22-d90e507c549c', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:44:07 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:44:07 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:44:07 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d704075-4b50-427c-baac-c5f9b463786d]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:08 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.230s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:44:08 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD Jul 06 15:44:08 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 1.232s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:08 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:08 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67 Jul 06 15:44:08 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:09 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD" returned: 0 in 1.054s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:09 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD Jul 06 15:44:09 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:09 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-efe2719c-20b6-48f6-9592-f197e3e78a67" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Lock "cinder-quobyte-efe2719c-20b6-48f6-9592-f197e3e78a67" released by "delete_volume" :: held 2.163s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Created reservations ['abd99022-2218-48c4-b47d-7b02f2bf6d62', '337c8fb7-1a14-4bbc-a4a2-3e441bf70c34', '3fdea2f0-55f5-42e7-a628-9a5883fccfde', 'e4727997-8883-41aa-9e7c-7f68041af36f'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:09 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:09 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:10 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD" returned: 1 in 1.036s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Temporary image 77f2e033-c855-4473-bb22-d90e507c549c is fetched for user f2c6d51cf3a6414aa854779bc26663d1. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2843edbd-5b96-4e63-b169-0fd442f9b925]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:10 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD Jul 06 15:44:10 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:10 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.806s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Deleted volume successfully. Jul 06 15:44:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ee2747db-4437-4035-96c9-5c56efcae049 tempest-TestStampPattern-470785233 None] Lock "cinder-efe2719c-20b6-48f6-9592-f197e3e78a67-delete_volume" released by "delete_volume" :: held 3.349s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:11 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:11 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD Jul 06 15:44:11 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:12 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD" returned: 1 in 0.969s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9685e2e2-7136-4cea-b677-666cc2a26c27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669333dbe6bb44ae92adbecb25ec1491',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:07Z,use_quota=True,user_id='f2c6d51cf3a6414aa854779bc26663d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Creating volume 9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:12 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:12 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 1073741824 Jul 06 15:44:12 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:13 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 1073741824" returned: 0 in 1.113s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:13 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:13 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:14 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 0 in 0.820s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:14 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Attempting download of 77f2e033-c855-4473-bb22-d90e507c549c ((None, [{'url': 'file:///opt/stack/data/glance/images/77f2e033-c855-4473-bb22-d90e507c549c', 'metadata': {}}])) to volume 9685e2e2-7136-4cea-b677-666cc2a26c27. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:44:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defa595-6c8a-4b1c-b9bc-beb9a7cf5451]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:14 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0 Jul 06 15:44:14 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:15 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0" returned: 0 in 0.999s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:15 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0 Jul 06 15:44:15 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:16 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0" returned: 1 in 1.161s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77f2e033-c855-4473-bb22-d90e507c549c_b73qmof0' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[236ca61d-1aca-40b5-964c-7790476783db]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:16 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD Jul 06 15:44:16 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:17 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD" returned: 0 in 1.074s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:17 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD Jul 06 15:44:17 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:18 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD" returned: 1 in 0.896s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] 77f2e033-c855-4473-bb22-d90e507c549c was raw, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:18 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:18 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (801c6400-ee96-4ccc-b86e-61c951557833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80857757-dc07-4d45-9252-191237951e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80857757-dc07-4d45-9252-191237951e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-68368213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1123af52-ee3b-48cf-bddd-264b62bb076a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:18Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6083c9-4de7-44e5-ba74-5bcb17289a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6083c9-4de7-44e5-ba74-5bcb17289a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fcf93e-927c-4935-8e34-30881ac70dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fcf93e-927c-4935-8e34-30881ac70dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1123af52-ee3b-48cf-bddd-264b62bb076a', 'volume_name': 'volume-1123af52-ee3b-48cf-bddd-264b62bb076a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4067e2-c95e-4c8b-87e6-f9d148219036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4067e2-c95e-4c8b-87e6-f9d148219036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076bdeb6-4be5-4f8f-98f4-563689e226f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:18 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume 1123af52-ee3b-48cf-bddd-264b62bb076a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1123af52-ee3b-48cf-bddd-264b62bb076a', 'volume_size': 1} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-68368213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1123af52-ee3b-48cf-bddd-264b62bb076a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:18Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Creating volume 1123af52-ee3b-48cf-bddd-264b62bb076a {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:18 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:18 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a 1073741824 Jul 06 15:44:18 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:19 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 0 in 0.788s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:19 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77f2e033-c855-4473-bb22-d90e507c549c_ka184n7ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:44:19 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:44:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:19 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 1G Jul 06 15:44:19 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:19 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a 1073741824" returned: 0 in 0.973s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:19 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a Jul 06 15:44:19 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:19 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 1G" returned: 0 in 0.777s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e905639-c7df-4f46-9bf5-c6030d756617]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:20 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:20 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:20 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a" returned: 0 in 0.697s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (076bdeb6-4be5-4f8f-98f4-563689e226f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1123af52-ee3b-48cf-bddd-264b62bb076a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75449dbc-3855-476a-b807-f8f9272aa522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:20 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume volume-1123af52-ee3b-48cf-bddd-264b62bb076a (1123af52-ee3b-48cf-bddd-264b62bb076a): created successfully Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75449dbc-3855-476a-b807-f8f9272aa522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (801c6400-ee96-4ccc-b86e-61c951557833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b1bc06f1-3854-48f9-9f0d-812c920b4aae tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created volume successfully. Jul 06 15:44:20 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 0 in 0.889s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:21 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:21 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (2f903ea0-929e-47e4-97a8-0cdf4b50375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fdac58-e60f-4f8f-9010-a9c8b115618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fdac58-e60f-4f8f-9010-a9c8b115618a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272244170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af832d15-89dc-4b95-ab87-93e238f28102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:21Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbc3c72-d3c3-414a-a529-028f4a55df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbc3c72-d3c3-414a-a529-028f4a55df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473b4a07-0dae-4528-98b7-ced3b8689e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473b4a07-0dae-4528-98b7-ced3b8689e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af832d15-89dc-4b95-ab87-93e238f28102', 'volume_name': 'volume-af832d15-89dc-4b95-ab87-93e238f28102', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f42249d-fabc-4edc-bae1-95cbf6fb6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f42249d-fabc-4edc-bae1-95cbf6fb6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f99750-70f6-4d8c-b54d-f258af166077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume af832d15-89dc-4b95-ab87-93e238f28102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af832d15-89dc-4b95-ab87-93e238f28102', 'volume_size': 1} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1272244170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af832d15-89dc-4b95-ab87-93e238f28102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:21Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Creating volume af832d15-89dc-4b95-ab87-93e238f28102 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:21 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:21 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 1073741824 Jul 06 15:44:21 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (eba56ed0-dcf8-4082-8117-50224baf85a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b28ee6a-ef66-48ae-8e59-9c1995f8a367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b28ee6a-ef66-48ae-8e59-9c1995f8a367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258959498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ca2c8f-a297-4967-8cc8-b2981076910e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:22Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78c74b3-5546-49c4-8a5e-d8be2a72ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78c74b3-5546-49c4-8a5e-d8be2a72ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55f26b8-cce0-414f-8d7c-be0d66460335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55f26b8-cce0-414f-8d7c-be0d66460335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ca2c8f-a297-4967-8cc8-b2981076910e', 'volume_name': 'volume-27ca2c8f-a297-4967-8cc8-b2981076910e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f098a1e7-a41b-4ccb-886d-7157f52ee947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f098a1e7-a41b-4ccb-886d-7157f52ee947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e935fd-5422-48a4-aa5d-97eb9367a877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:21 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume 27ca2c8f-a297-4967-8cc8-b2981076910e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ca2c8f-a297-4967-8cc8-b2981076910e', 'volume_size': 1} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:21 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 1 in 1.039s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Downloaded image 77f2e033-c855-4473-bb22-d90e507c549c ((None, [{'url': 'file:///opt/stack/data/glance/images/77f2e033-c855-4473-bb22-d90e507c549c', 'metadata': {}}])) to volume 9685e2e2-7136-4cea-b677-666cc2a26c27 successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Temporary image 77f2e033-c855-4473-bb22-d90e507c549c for user f2c6d51cf3a6414aa854779bc26663d1 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Marking volume 9685e2e2-7136-4cea-b677-666cc2a26c27 as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Copying metadata from image 77f2e033-c855-4473-bb22-d90e507c549c to 9685e2e2-7136-4cea-b677-666cc2a26c27. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:44:21 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Creating volume glance metadata for volume 9685e2e2-7136-4cea-b677-666cc2a26c27 backed by image 77f2e033-c855-4473-bb22-d90e507c549c with: {'image_id': '77f2e033-c855-4473-bb22-d90e507c549c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7abc372e55425f58cc517f0bdfd10ac3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (2b7deb81-293f-433d-a295-0944ce2d986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88fd9a1-37b0-4590-8e6d-66a2c42576c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88fd9a1-37b0-4590-8e6d-66a2c42576c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86638857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271b7445-eafe-4ab7-8a82-1c6b150f0e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:22Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8eb963c-bf55-46c1-81b2-e5e581ff66dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8eb963c-bf55-46c1-81b2-e5e581ff66dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0138b96-1c90-4c72-b34d-5327ab2d3074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0138b96-1c90-4c72-b34d-5327ab2d3074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271b7445-eafe-4ab7-8a82-1c6b150f0e17', 'volume_name': 'volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42e04be-1c71-416c-b539-54fadd9a0f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f42e04be-1c71-416c-b539-54fadd9a0f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575044ac-114c-4f6b-9900-ad38aa480ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume 271b7445-eafe-4ab7-8a82-1c6b150f0e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17', 'volume_size': 1} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73dbf74-7502-4784-a52f-6dd53d088c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9685e2e2-7136-4cea-b677-666cc2a26c27', 'volume_size': 1, 'image_id': '77f2e033-c855-4473-bb22-d90e507c549c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77f2e033-c855-4473-bb22-d90e507c549c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7abc372e55425f58cc517f0bdfd10ac3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '669333dbe6bb44ae92adbecb25ec1491', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9f74e84563c5eb6c7c8df89ee8aade551ecf4071e5d90a48ef3c46dd8b133d76a34c18ec815cea779cad10b535168b9432e23dbe889eb4bd653f6b2b07dfbdef', 'id': '77f2e033-c855-4473-bb22-d90e507c549c', 'created_at': datetime.datetime(2026, 7, 6, 13, 44, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 44, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77f2e033-c855-4473-bb22-d90e507c549c/file', 'properties': {}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc8cd9d-ed8b-4883-8289-2941a323de3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Volume volume-9685e2e2-7136-4cea-b677-666cc2a26c27 (9685e2e2-7136-4cea-b677-666cc2a26c27): created successfully Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bc8cd9d-ed8b-4883-8289-2941a323de3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Flow 'volume_create_manager' (4c802473-bf1b-492b-b4cc-fb0c1865037e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4172f4dd-0d1a-4f6b-9454-076ee3591312 tempest-VolumeImageDependencyTests-1858915384 None] Created volume successfully. Jul 06 15:44:22 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 1073741824" returned: 0 in 1.216s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:22 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 Jul 06 15:44:22 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (ebedd556-2937-4a6f-bf9c-43c33bc4b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349a173f-424e-4205-bcd9-1637e8f89f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349a173f-424e-4205-bcd9-1637e8f89f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485565106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39f1721-fd79-4eb0-a635-b8718b604735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:23Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d8dd64-248a-469d-aac1-6510df37f84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d8dd64-248a-469d-aac1-6510df37f84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c28c93-f3ba-4d91-8b32-4c1a2c541a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c28c93-f3ba-4d91-8b32-4c1a2c541a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd39f1721-fd79-4eb0-a635-b8718b604735', 'volume_name': 'volume-d39f1721-fd79-4eb0-a635-b8718b604735', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d2c425-e899-4627-ba81-1b50f8bbff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d2c425-e899-4627-ba81-1b50f8bbff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b61481-85fe-45eb-9671-ea48d2b516b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:22 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume d39f1721-fd79-4eb0-a635-b8718b604735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d39f1721-fd79-4eb0-a635-b8718b604735', 'volume_size': 1} Jul 06 15:44:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (e8990f12-eed3-46bd-871d-9156002c5233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665cb008-adf7-4fd0-8fd0-9047e8a84fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665cb008-adf7-4fd0-8fd0-9047e8a84fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59355572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dc769d-9fa7-4b60-aa0a-d7c356fe183e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:23Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710166aa-ace0-4f09-bd8d-8ce6c4199c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710166aa-ace0-4f09-bd8d-8ce6c4199c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7ea08f-d0d8-4ab7-98ee-c8381e59abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7ea08f-d0d8-4ab7-98ee-c8381e59abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dc769d-9fa7-4b60-aa0a-d7c356fe183e', 'volume_name': 'volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb1b411-d573-47b1-b7c0-204188c11e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb1b411-d573-47b1-b7c0-204188c11e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7640db33-05b2-465d-87c3-0bfb2ca086b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume f0dc769d-9fa7-4b60-aa0a-d7c356fe183e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e', 'volume_size': 1} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:23 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102" returned: 0 in 0.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.319s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-258959498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ca2c8f-a297-4967-8cc8-b2981076910e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:22Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Creating volume 27ca2c8f-a297-4967-8cc8-b2981076910e {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:23 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:23 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e 1073741824 Jul 06 15:44:23 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f99750-70f6-4d8c-b54d-f258af166077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af832d15-89dc-4b95-ab87-93e238f28102', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac3d5a4-c436-4cf4-b0b9-31b461ceb94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume volume-af832d15-89dc-4b95-ab87-93e238f28102 (af832d15-89dc-4b95-ab87-93e238f28102): created successfully Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac3d5a4-c436-4cf4-b0b9-31b461ceb94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (2f903ea0-929e-47e4-97a8-0cdf4b50375a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2b9a0967-cebe-4582-81d0-3c85486531f1 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created volume successfully. Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Acquiring lock "cinder-9685e2e2-7136-4cea-b677-666cc2a26c27-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Lock "cinder-9685e2e2-7136-4cea-b677-666cc2a26c27-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Acquiring lock "cinder-quobyte-9685e2e2-7136-4cea-b677-666cc2a26c27" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Lock "cinder-quobyte-9685e2e2-7136-4cea-b677-666cc2a26c27" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7c6a5-6439-4293-8b77-639448d9fac1]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:23 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:23 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e 1073741824" returned: 0 in 1.019s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:24 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=99,cinder:UPDATE=100,cinder:INSERT=30,cinder:DELETE=3 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:24 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e Jul 06 15:44:24 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:24 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 0 in 0.946s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:24 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:24 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:24 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e" returned: 0 in 0.663s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.791s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-86638857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271b7445-eafe-4ab7-8a82-1c6b150f0e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:22Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Creating volume 271b7445-eafe-4ab7-8a82-1c6b150f0e17 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:25 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:25 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 1073741824 Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e935fd-5422-48a4-aa5d-97eb9367a877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ca2c8f-a297-4967-8cc8-b2981076910e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:25 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a612694-91c4-4638-b9b4-46488aadf91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume volume-27ca2c8f-a297-4967-8cc8-b2981076910e (27ca2c8f-a297-4967-8cc8-b2981076910e): created successfully Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a612694-91c4-4638-b9b4-46488aadf91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (eba56ed0-dcf8-4082-8117-50224baf85a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-44f576a9-62dc-4028-9007-d635806b6969 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created volume successfully. Jul 06 15:44:25 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 1 in 0.862s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:25 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27 Jul 06 15:44:25 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:25 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 1073741824" returned: 0 in 0.945s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:25 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=81,cinder:UPDATE=81,cinder:DELETE=11,cinder:INSERT=29 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:26 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 Jul 06 15:44:26 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:26 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (7b36ba20-b5c9-4156-a803-8171ca87dd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc22c52-cec5-405a-bcd1-65314d7ccddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9685e2e2-7136-4cea-b677-666cc2a26c27" returned: 0 in 0.845s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Lock "cinder-quobyte-9685e2e2-7136-4cea-b677-666cc2a26c27" released by "delete_volume" :: held 2.741s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc22c52-cec5-405a-bcd1-65314d7ccddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1102275126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ec2a0d-7fa0-46ed-8e32-f67e71e406a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:26Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19027d7-d610-4d07-ab4e-d4d35842cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19027d7-d610-4d07-ab4e-d4d35842cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20739a14-073a-4a90-8f59-a9aaa770a855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20739a14-073a-4a90-8f59-a9aaa770a855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ec2a0d-7fa0-46ed-8e32-f67e71e406a0', 'volume_name': 'volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65277c04-b23c-420d-a11f-9fdbfffbf592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65277c04-b23c-420d-a11f-9fdbfffbf592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83827238-72aa-48d9-9274-267295ac3d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Volume 55ec2a0d-7fa0-46ed-8e32-f67e71e406a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0', 'volume_size': 1} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Created reservations ['d9d9c2eb-a03b-4adc-ba87-16c6fd7f4394', '8974ae76-d0cd-4659-9f95-fbc06ff4eafe', '9cb65216-8e72-4664-8fdc-ce4d1119beb8', 'e9f3291c-b400-463a-bb59-e9e6a33419e5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:26 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:26 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (0a656edf-1eb9-4867-8ca8-312dcb926ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79874019-9856-4e85-b273-e190740e05dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79874019-9856-4e85-b273-e190740e05dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503478239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd10f29-15d8-4d88-ab5b-9858f1da1259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:27Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc10a1a-80e4-4904-b35a-4143a41f7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc10a1a-80e4-4904-b35a-4143a41f7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108c3d02-7aa6-4501-b9ac-13e9173c37d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108c3d02-7aa6-4501-b9ac-13e9173c37d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd10f29-15d8-4d88-ab5b-9858f1da1259', 'volume_name': 'volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38ca0da-c4fe-4869-8df7-96978423bd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38ca0da-c4fe-4869-8df7-96978423bd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74023052-e008-4575-9a67-7577c7189325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:26 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Volume 4fd10f29-15d8-4d88-ab5b-9858f1da1259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259', 'volume_size': 1} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:26 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17" returned: 0 in 0.941s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.187s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485565106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d39f1721-fd79-4eb0-a635-b8718b604735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:23Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Creating volume d39f1721-fd79-4eb0-a635-b8718b604735 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:26 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (575044ac-114c-4f6b-9900-ad38aa480ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 1073741824 Jul 06 15:44:27 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aec4120-4908-44d9-b1cc-4f97f48ab429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 (271b7445-eafe-4ab7-8a82-1c6b150f0e17): created successfully Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aec4120-4908-44d9-b1cc-4f97f48ab429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (2b7deb81-293f-433d-a295-0944ce2d986a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5388c5c2-96a1-45a5-ba50-048a78fd64b5 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created volume successfully. Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (fe6fe148-79b9-46c1-9181-35a71b958fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dd5e8e-1458-4579-b3bf-33414b8d8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dd5e8e-1458-4579-b3bf-33414b8d8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639041257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc0d53-4461-4ed7-a0a0-2c75de391f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:27Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbf4e53-aac5-462e-9f8f-dfe605bd1f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbf4e53-aac5-462e-9f8f-dfe605bd1f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70f7465-2935-4ad5-9903-0a1fc676e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70f7465-2935-4ad5-9903-0a1fc676e107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cebc0d53-4461-4ed7-a0a0-2c75de391f89', 'volume_name': 'volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6679f1fb-979e-42fc-a6e3-49e5e959fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6679f1fb-979e-42fc-a6e3-49e5e959fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399df904-3a3c-4928-88b1-a07b33cf4f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Volume cebc0d53-4461-4ed7-a0a0-2c75de391f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89', 'volume_size': 1} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:27 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.964s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:27 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Deleted volume successfully. Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5e337a4d-2393-43fa-93d4-15e104c275cf tempest-VolumeImageDependencyTests-1858915384 None] Lock "cinder-9685e2e2-7136-4cea-b677-666cc2a26c27-delete_volume" released by "delete_volume" :: held 4.076s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (64b7da36-50ad-4760-983b-04185bbe009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d16ab7-c4ba-4dde-be3a-364d56f9402f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d16ab7-c4ba-4dde-be3a-364d56f9402f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725320459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a81bb7-87a0-47d3-b431-3c621b3e57cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:28Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1bd3fd-99a5-4ff9-b78b-a4fb6124e149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1bd3fd-99a5-4ff9-b78b-a4fb6124e149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd09b6e-0ca7-414f-89ae-64034188ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd09b6e-0ca7-414f-89ae-64034188ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a81bb7-87a0-47d3-b431-3c621b3e57cf', 'volume_name': 'volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5dd9777-ac87-45b8-ba41-3e87b755691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5dd9777-ac87-45b8-ba41-3e87b755691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989f6096-04c1-492d-a2b9-d2c984b5bfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:27 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Volume 04a81bb7-87a0-47d3-b431-3c621b3e57cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf', 'volume_size': 1} Jul 06 15:44:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (6a254d75-a07c-4091-93e4-2d91d05adf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cf61a7-1b64-4f21-80f7-9e333fc533da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cf61a7-1b64-4f21-80f7-9e333fc533da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794653071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea11fa74-97a8-4750-8e38-c267d16e7924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:28Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc858951-4659-4d91-96b7-03e79eee37d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc858951-4659-4d91-96b7-03e79eee37d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a8fdd5-2076-4f39-824c-1c2baed513a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a8fdd5-2076-4f39-824c-1c2baed513a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea11fa74-97a8-4750-8e38-c267d16e7924', 'volume_name': 'volume-ea11fa74-97a8-4750-8e38-c267d16e7924', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f1045d-9941-40d2-94a5-6834879bd70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f1045d-9941-40d2-94a5-6834879bd70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c50f253-7dae-438a-8a2d-2a7fd5812136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Volume ea11fa74-97a8-4750-8e38-c267d16e7924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea11fa74-97a8-4750-8e38-c267d16e7924', 'volume_size': 1} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:28 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 1073741824" returned: 0 in 1.271s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:28 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 Jul 06 15:44:28 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:28 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735" returned: 0 in 0.713s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.915s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59355572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dc769d-9fa7-4b60-aa0a-d7c356fe183e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89beb7bdcd9e42558c5bcf6e6ba3c24e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:23Z,use_quota=True,user_id='371b0f0e06eb491f86fca53420c95758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Creating volume f0dc769d-9fa7-4b60-aa0a-d7c356fe183e {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:29 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b61481-85fe-45eb-9671-ea48d2b516b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d39f1721-fd79-4eb0-a635-b8718b604735', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:29 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e 1073741824 Jul 06 15:44:29 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d6d3e5-1133-455b-b5cc-6e24deeb7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume volume-d39f1721-fd79-4eb0-a635-b8718b604735 (d39f1721-fd79-4eb0-a635-b8718b604735): created successfully Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d6d3e5-1133-455b-b5cc-6e24deeb7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (ebedd556-2937-4a6f-bf9c-43c33bc4b08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5b866e76-9cfc-45ec-9a39-4f3fa7ee4042 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created volume successfully. Jul 06 15:44:29 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e 1073741824" returned: 0 in 0.879s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:29 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e Jul 06 15:44:29 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:30 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e" returned: 0 in 0.623s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.210s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1102275126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ec2a0d-7fa0-46ed-8e32-f67e71e406a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:26Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Creating volume 55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:30 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:30 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 1073741824 Jul 06 15:44:30 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7640db33-05b2-465d-87c3-0bfb2ca086b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905cc192-cedb-4d18-879d-07c1ecefb33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Volume volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e (f0dc769d-9fa7-4b60-aa0a-d7c356fe183e): created successfully Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905cc192-cedb-4d18-879d-07c1ecefb33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Flow 'volume_create_manager' (e8990f12-eed3-46bd-871d-9156002c5233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a8561ef7-e980-4f0e-b59a-c679a3d37065 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created volume successfully. Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-quobyte-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e" acquired by "delete_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb342c7-6e2e-4a01-8744-c0609a356cf1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:31 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e Jul 06 15:44:31 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Flow 'volume_create_manager' (05a49e97-af82-4344-a708-a345ad090861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3323411b-52df-4653-990f-a684f3dfa154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3323411b-52df-4653-990f-a684f3dfa154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829433011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda0bb80-9987-4a60-9335-990a9daf5ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e650262196ee46209593543cb6eb622a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:31Z,use_quota=True,user_id='8c8af008e4f642aabd1792163a754aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017f4043-9e20-44a7-b819-eb791a380227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017f4043-9e20-44a7-b819-eb791a380227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6a54b8-5849-4e76-9ec2-fd1087bdd951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6a54b8-5849-4e76-9ec2-fd1087bdd951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda0bb80-9987-4a60-9335-990a9daf5ff9', 'volume_name': 'volume-fda0bb80-9987-4a60-9335-990a9daf5ff9', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37d9d33-2995-485b-b58e-fa7c9368d12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37d9d33-2995-485b-b58e-fa7c9368d12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b2d4ee-35a3-4596-b039-ddc6faf01c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Volume fda0bb80-9987-4a60-9335-990a9daf5ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda0bb80-9987-4a60-9335-990a9daf5ff9', 'volume_size': 1} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:31 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 1073741824" returned: 0 in 0.911s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:31 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 Jul 06 15:44:31 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:31 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e" returned: 0 in 0.821s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:31 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e Jul 06 15:44:31 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:32 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0" returned: 0 in 0.672s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.291s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503478239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd10f29-15d8-4d88-ab5b-9858f1da1259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:27Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Creating volume 4fd10f29-15d8-4d88-ab5b-9858f1da1259 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:32 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:32 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 1073741824 Jul 06 15:44:32 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83827238-72aa-48d9-9274-267295ac3d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5870e2f0-d49b-465b-a516-20c8270242a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Volume volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 (55ec2a0d-7fa0-46ed-8e32-f67e71e406a0): created successfully Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5870e2f0-d49b-465b-a516-20c8270242a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (7b36ba20-b5c9-4156-a803-8171ca87dd0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1e35d4f4-a135-4287-8b52-2824b594298f tempest-CreateVolumesFromImageTest-39990344 None] Created volume successfully. Jul 06 15:44:32 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e" returned: 0 in 0.651s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e" released by "delete_volume" :: held 1.521s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created reservations ['73bb537c-59fe-45f3-9621-a4cd3e1f81cd', 'b98e2441-964c-45a9-990f-a8ce2cfe5b52', 'ca906d4f-a21f-4d5f-b7b0-c3acc78c499e', 'f6d28e0e-085f-418b-b4cb-6f936084c21b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:32 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:32 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-d39f1721-fd79-4eb0-a635-b8718b604735-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-d39f1721-fd79-4eb0-a635-b8718b604735-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-quobyte-d39f1721-fd79-4eb0-a635-b8718b604735" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:33 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 1073741824" returned: 0 in 0.918s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-d39f1721-fd79-4eb0-a635-b8718b604735" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4f9b1-bf23-42ee-ad6c-2531154697a1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:33 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 Jul 06 15:44:33 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:33 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.700s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Deleted volume successfully. Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a3c8521f-e0e6-4e4e-b2a1-5e5a0901e858 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-f0dc769d-9fa7-4b60-aa0a-d7c356fe183e-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:33 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 Jul 06 15:44:33 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:33 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259" returned: 0 in 0.656s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.499s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639041257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cebc0d53-4461-4ed7-a0a0-2c75de391f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:27Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Creating volume cebc0d53-4461-4ed7-a0a0-2c75de391f89 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:33 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:33 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 1073741824 Jul 06 15:44:33 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74023052-e008-4575-9a67-7577c7189325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae480a9a-a39f-4871-82d0-f5dd6bdf69c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:33 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Volume volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 (4fd10f29-15d8-4d88-ab5b-9858f1da1259): created successfully Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae480a9a-a39f-4871-82d0-f5dd6bdf69c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (0a656edf-1eb9-4867-8ca8-312dcb926ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f0a0450d-1000-4f77-a9f7-1587e1068d4b tempest-CreateVolumesFromImageTest-39990344 None] Created volume successfully. Jul 06 15:44:33 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:33 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735 Jul 06 15:44:33 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:34 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d39f1721-fd79-4eb0-a635-b8718b604735" returned: 0 in 0.651s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-d39f1721-fd79-4eb0-a635-b8718b604735" released by "delete_volume" :: held 1.501s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created reservations ['042a4a18-7f7f-4b60-a11b-81e09531ac1d', '15ca693e-bfd0-44c5-b42f-2dc09e266950', 'b38b6a68-4819-456b-8abb-175f429dd035', 'd6ba71f5-4e8d-45f6-8cc0-82e0d42f5e49'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:34 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 1073741824" returned: 0 in 0.842s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:34 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 Jul 06 15:44:34 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:34 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:34 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-271b7445-eafe-4ab7-8a82-1c6b150f0e17-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-271b7445-eafe-4ab7-8a82-1c6b150f0e17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-quobyte-271b7445-eafe-4ab7-8a82-1c6b150f0e17" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-271b7445-eafe-4ab7-8a82-1c6b150f0e17" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:35 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47a4c86-bb8b-4d7e-ba19-837e0181b557]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:35 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89" returned: 0 in 0.693s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.677s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.699s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725320459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a81bb7-87a0-47d3-b431-3c621b3e57cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:28Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Creating volume 04a81bb7-87a0-47d3-b431-3c621b3e57cf {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:35 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Deleted volume successfully. Jul 06 15:44:35 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf 1073741824 Jul 06 15:44:35 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399df904-3a3c-4928-88b1-a07b33cf4f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9636b82-b1f5-4291-8764-2d714e2aa3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:35 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Volume volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 (cebc0d53-4461-4ed7-a0a0-2c75de391f89): created successfully Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9636b82-b1f5-4291-8764-2d714e2aa3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (fe6fe148-79b9-46c1-9181-35a71b958fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5d6d97a1-2b06-487d-bb26-ecc3f9d951c9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-d39f1721-fd79-4eb0-a635-b8718b604735-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:35 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 Jul 06 15:44:35 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b7b4a77a-dce2-44ad-897b-c5fc515f759e tempest-CreateVolumesFromImageTest-39990344 None] Created volume successfully. Jul 06 15:44:36 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:36 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17 Jul 06 15:44:36 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:36 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf 1073741824" returned: 0 in 0.919s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:36 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf Jul 06 15:44:36 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:36 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-271b7445-eafe-4ab7-8a82-1c6b150f0e17" returned: 0 in 0.648s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-271b7445-eafe-4ab7-8a82-1c6b150f0e17" released by "delete_volume" :: held 1.488s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created reservations ['8ddeed0a-6530-453a-9281-79e69c93ce5a', '5ddee1c8-5a7b-40c3-ac05-7a3917aaf921', '085a29fe-ce32-49b4-b5d0-60b49bd33ece', '41c142ed-8783-4afa-bf8b-dd0a601cd282'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:37 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:37 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:37 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf" returned: 0 in 0.661s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.889s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794653071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea11fa74-97a8-4750-8e38-c267d16e7924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='030d7ef4fe0148c685fcf1e0b8b10dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:28Z,use_quota=True,user_id='3035e5846f5f444a82df9a5649608655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Creating volume ea11fa74-97a8-4750-8e38-c267d16e7924 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:37 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989f6096-04c1-492d-a2b9-d2c984b5bfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:37 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 1073741824 Jul 06 15:44:37 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ed7832-d5b5-4051-9726-1b1ff5203e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:37 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Volume volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf (04a81bb7-87a0-47d3-b431-3c621b3e57cf): created successfully Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ed7832-d5b5-4051-9726-1b1ff5203e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (64b7da36-50ad-4760-983b-04185bbe009b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a314b593-887c-4a22-a604-0f1b130b3b66 tempest-CreateVolumesFromImageTest-39990344 None] Created volume successfully. Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-27ca2c8f-a297-4967-8cc8-b2981076910e-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-27ca2c8f-a297-4967-8cc8-b2981076910e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-quobyte-27ca2c8f-a297-4967-8cc8-b2981076910e" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-27ca2c8f-a297-4967-8cc8-b2981076910e" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:37 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.678s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Deleted volume successfully. Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825d1d5-3c7b-437b-99e5-04f6ea8dc132]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ddaa9941-cf93-4be3-8747-2f69e807be9b tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-271b7445-eafe-4ab7-8a82-1c6b150f0e17-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:37 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e Jul 06 15:44:37 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:38 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 1073741824" returned: 0 in 0.978s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:38 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 Jul 06 15:44:38 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:38 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e" returned: 0 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:38 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e Jul 06 15:44:38 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:38 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924" returned: 0 in 0.639s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.341s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-829433011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda0bb80-9987-4a60-9335-990a9daf5ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e650262196ee46209593543cb6eb622a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:31Z,use_quota=True,user_id='8c8af008e4f642aabd1792163a754aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Creating volume fda0bb80-9987-4a60-9335-990a9daf5ff9 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:38 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:38 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 1073741824 Jul 06 15:44:38 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c50f253-7dae-438a-8a2d-2a7fd5812136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea11fa74-97a8-4750-8e38-c267d16e7924', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b7e3b9-5445-4192-a5c8-d814eaedee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:38 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Volume volume-ea11fa74-97a8-4750-8e38-c267d16e7924 (ea11fa74-97a8-4750-8e38-c267d16e7924): created successfully Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b7e3b9-5445-4192-a5c8-d814eaedee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Flow 'volume_create_manager' (6a254d75-a07c-4091-93e4-2d91d05adf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-afa61a6b-f116-4050-a664-bb309b3ac5e9 tempest-CreateVolumesFromImageTest-39990344 None] Created volume successfully. Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-ea11fa74-97a8-4750-8e38-c267d16e7924-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-ea11fa74-97a8-4750-8e38-c267d16e7924-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-quobyte-ea11fa74-97a8-4750-8e38-c267d16e7924" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-ea11fa74-97a8-4750-8e38-c267d16e7924" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08ed763-5452-4ae0-93b0-fdf4a8dfb89e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:39 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 Jul 06 15:44:39 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:39 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-27ca2c8f-a297-4967-8cc8-b2981076910e" returned: 0 in 0.776s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-27ca2c8f-a297-4967-8cc8-b2981076910e" released by "delete_volume" :: held 1.681s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created reservations ['b2c2251e-b1dd-4fc2-b193-db036c86a62d', '178a50c4-5db1-4ee4-ae83-067ce8a1b740', 'd35e0a22-df4b-417d-8e61-af8ca5b0f7c4', 'c7612446-cc1e-4eb2-95b2-4cd7f29a0241'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:39 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:39 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:39 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 1073741824" returned: 0 in 0.948s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:39 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 Jul 06 15:44:39 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-af832d15-89dc-4b95-ab87-93e238f28102-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-af832d15-89dc-4b95-ab87-93e238f28102-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-quobyte-af832d15-89dc-4b95-ab87-93e238f28102" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-af832d15-89dc-4b95-ab87-93e238f28102" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fad572-d143-45e1-b18a-6f3535598932]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:39 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:40 devstack sudo[103671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924 Jul 06 15:44:40 devstack sudo[103671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:40 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 Jul 06 15:44:40 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:40 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.788s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Deleted volume successfully. Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-151edafe-a044-4561-9478-4299656afc9e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-27ca2c8f-a297-4967-8cc8-b2981076910e-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:40 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9" returned: 0 in 0.802s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b2d4ee-35a3-4596-b039-ddc6faf01c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda0bb80-9987-4a60-9335-990a9daf5ff9', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b82c276-82a5-48e2-b52c-adb9b8ed503f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Volume volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 (fda0bb80-9987-4a60-9335-990a9daf5ff9): created successfully Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b82c276-82a5-48e2-b52c-adb9b8ed503f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Flow 'volume_create_manager' (05a49e97-af82-4344-a708-a345ad090861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a1043bba-659f-4d64-a25b-4aead572d08a tempest-ProjectReaderTests-1605983496 None] Created volume successfully. Jul 06 15:44:40 devstack sudo[103671]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-ea11fa74-97a8-4750-8e38-c267d16e7924" returned: 0 in 0.672s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-ea11fa74-97a8-4750-8e38-c267d16e7924" released by "delete_volume" :: held 1.556s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Created reservations ['a7d752ed-6257-45d1-bc29-fa4cc006bd68', '64851500-ecc7-473c-945a-d5204f6c33a6', '293d18ef-19e1-4216-8faf-2489745b5f38', 'feb4e28f-5f82-4e7d-9012-c454108c1df5'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:40 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102" returned: 0 in 0.871s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:40 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:40 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:40 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102 Jul 06 15:44:40 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Acquiring lock "cinder-fda0bb80-9987-4a60-9335-990a9daf5ff9-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Lock "cinder-fda0bb80-9987-4a60-9335-990a9daf5ff9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Acquiring lock "cinder-quobyte-fda0bb80-9987-4a60-9335-990a9daf5ff9" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Lock "cinder-quobyte-fda0bb80-9987-4a60-9335-990a9daf5ff9" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e621b3-f31a-41ea-9aed-88ed9dfddc7e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:41 devstack sudo[103684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 Jul 06 15:44:41 devstack sudo[103684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-04a81bb7-87a0-47d3-b431-3c621b3e57cf-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-04a81bb7-87a0-47d3-b431-3c621b3e57cf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-quobyte-04a81bb7-87a0-47d3-b431-3c621b3e57cf" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-04a81bb7-87a0-47d3-b431-3c621b3e57cf" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb999756-3bff-4f01-bfcb-f10074a4d01e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:41 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-af832d15-89dc-4b95-ab87-93e238f28102" returned: 0 in 0.742s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:41 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-af832d15-89dc-4b95-ab87-93e238f28102" released by "delete_volume" :: held 1.658s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:41 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf Jul 06 15:44:41 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:41 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Deleted volume successfully. Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c93cdb5-c61a-49e7-9545-336e316640ec tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-ea11fa74-97a8-4750-8e38-c267d16e7924-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created reservations ['18a7634e-ed8d-46bb-8d58-14e85f70605a', '6cbbe88f-5105-4ac6-8ee3-a355097df698', 'f6ab201f-833c-4021-99d3-c4d10c4f38d2', 'e16070da-a5fc-46a0-828a-1934f3316bd3'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:41 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:41 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:41 devstack sudo[103684]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9" returned: 0 in 0.848s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:41 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9 Jul 06 15:44:41 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-1123af52-ee3b-48cf-bddd-264b62bb076a-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-1123af52-ee3b-48cf-bddd-264b62bb076a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "cinder-quobyte-1123af52-ee3b-48cf-bddd-264b62bb076a" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-1123af52-ee3b-48cf-bddd-264b62bb076a" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44d89f3-f6d4-4ae7-96b0-d811f1d48baa]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:42 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf" returned: 0 in 0.876s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:42 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf Jul 06 15:44:42 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:42 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a Jul 06 15:44:42 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:42 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Deleted volume successfully. Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d338d24d-42ee-469c-9bbb-c50456538f2e tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-af832d15-89dc-4b95-ab87-93e238f28102-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:42 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fda0bb80-9987-4a60-9335-990a9daf5ff9" returned: 0 in 0.755s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Lock "cinder-quobyte-fda0bb80-9987-4a60-9335-990a9daf5ff9" released by "delete_volume" :: held 1.645s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Created reservations ['c4a03c56-42a7-4763-b86e-be702ba7bcff', 'e4240f2b-b89b-4e3e-908d-cf4d37049f91', '812173b3-cae8-4deb-b1a5-09e33adb7d0f', 'f799e085-b695-408e-86db-ea98cfca5010'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:42 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:42 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:43 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-04a81bb7-87a0-47d3-b431-3c621b3e57cf" returned: 0 in 0.696s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-04a81bb7-87a0-47d3-b431-3c621b3e57cf" released by "delete_volume" :: held 1.624s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:43 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a" returned: 0 in 0.780s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:43 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a Jul 06 15:44:43 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Created reservations ['8730eea6-f1c1-48f8-ae9c-805c749d80f8', '794d609e-f2a4-4f9a-b686-1c8b7e2058ac', '709018ed-666b-477f-a197-b0a53a5c9a1f', '26495d6a-1c4d-49dc-a250-8cb176a6b811'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:43 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:43 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-cebc0d53-4461-4ed7-a0a0-2c75de391f89-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:43 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.876s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Deleted volume successfully. Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-cebc0d53-4461-4ed7-a0a0-2c75de391f89-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:43 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1123af52-ee3b-48cf-bddd-264b62bb076a" returned: 0 in 0.760s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-quobyte-1123af52-ee3b-48cf-bddd-264b62bb076a" released by "delete_volume" :: held 1.600s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7bb78583-9009-417a-83b0-56bb8aca7d0a tempest-ProjectReaderTests-1605983496 None] Lock "cinder-fda0bb80-9987-4a60-9335-990a9daf5ff9-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-quobyte-cebc0d53-4461-4ed7-a0a0-2c75de391f89" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-cebc0d53-4461-4ed7-a0a0-2c75de391f89" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec807b-a030-4f12-b91b-9c66321e3609]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:43 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Created reservations ['f3f07fdb-e580-41c9-979a-8074c9f0b8a9', '034ef1aa-97d1-49ea-8ffd-ec61b80a853c', 'ab92cf49-ffe9-4e85-a1e3-9e0356233928', '8ce5d562-bd14-461f-98cd-aca6fb79b34d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:44 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 Jul 06 15:44:44 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:44 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:44 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:44 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.966s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Deleted volume successfully. Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3e7d8a8a-235a-4a93-8fe4-1e7e845d260f tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-04a81bb7-87a0-47d3-b431-3c621b3e57cf-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Flow 'volume_create_manager' (1e2238de-6edd-49b6-b6d6-4db601e323be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9178e210-1a5a-4043-ae84-7486691d5ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9178e210-1a5a-4043-ae84-7486691d5ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70358982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc04bbb9-4cd0-4936-ba22-658ab18c83cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e650262196ee46209593543cb6eb622a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:44Z,use_quota=True,user_id='8c8af008e4f642aabd1792163a754aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9ab0fd-aabd-4a6c-b28b-01b9b8aec672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9ab0fd-aabd-4a6c-b28b-01b9b8aec672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a4099-2409-4da9-8e13-28c5386ac5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6a4099-2409-4da9-8e13-28c5386ac5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc04bbb9-4cd0-4936-ba22-658ab18c83cb', 'volume_name': 'volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7214f8f5-e28e-42c3-8f6a-b0c40de161cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7214f8f5-e28e-42c3-8f6a-b0c40de161cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caea042-4f4e-4f4d-acce-94bf5f5d0cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Volume dc04bbb9-4cd0-4936-ba22-658ab18c83cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb', 'volume_size': 1} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70358982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc04bbb9-4cd0-4936-ba22-658ab18c83cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e650262196ee46209593543cb6eb622a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:44Z,use_quota=True,user_id='8c8af008e4f642aabd1792163a754aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Creating volume dc04bbb9-4cd0-4936-ba22-658ab18c83cb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:44 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:44 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb 1073741824 Jul 06 15:44:44 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:44 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89" returned: 0 in 0.915s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:44 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89 Jul 06 15:44:44 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:44 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.845s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Deleted volume successfully. Jul 06 15:44:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-935c60f7-f964-47f9-b6f8-efd8187ecbf9 tempest-CreateVolumesFromSourceVolumeTest-623458465 None] Lock "cinder-1123af52-ee3b-48cf-bddd-264b62bb076a-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:45 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb 1073741824" returned: 0 in 1.041s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:45 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb Jul 06 15:44:45 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:45 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-cebc0d53-4461-4ed7-a0a0-2c75de391f89" returned: 0 in 0.765s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-cebc0d53-4461-4ed7-a0a0-2c75de391f89" released by "delete_volume" :: held 1.736s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Created reservations ['0ea8686c-e62d-46c3-91dc-333cfdc3b9b4', '19716db9-c999-43be-8200-6b72c27f583f', '203f6557-43b5-4559-a833-c84d601021d2', 'afb3c2de-7bbc-4994-857e-41f2809f2891'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:45 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:45 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-4fd10f29-15d8-4d88-ab5b-9858f1da1259-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-4fd10f29-15d8-4d88-ab5b-9858f1da1259-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-quobyte-4fd10f29-15d8-4d88-ab5b-9858f1da1259" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-4fd10f29-15d8-4d88-ab5b-9858f1da1259" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc49606b-f0a0-4efb-a3d2-bdbc224039ad]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:46 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 Jul 06 15:44:46 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:46 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb" returned: 0 in 0.780s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caea042-4f4e-4f4d-acce-94bf5f5d0cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3f49af-4085-47c3-a7c0-a18bd882956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:46 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Volume volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb (dc04bbb9-4cd0-4936-ba22-658ab18c83cb): created successfully Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d3f49af-4085-47c3-a7c0-a18bd882956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Flow 'volume_create_manager' (1e2238de-6edd-49b6-b6d6-4db601e323be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b1e679c0-ce39-4bc3-a411-0bc45a323791 tempest-ProjectReaderTests-1605983496 None] Created volume successfully. Jul 06 15:44:46 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Deleted volume successfully. Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-401ee988-5ca9-4ac4-8c7f-7704580ecf06 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-cebc0d53-4461-4ed7-a0a0-2c75de391f89-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Acquiring lock "cinder-dc04bbb9-4cd0-4936-ba22-658ab18c83cb-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Lock "cinder-dc04bbb9-4cd0-4936-ba22-658ab18c83cb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Acquiring lock "cinder-quobyte-dc04bbb9-4cd0-4936-ba22-658ab18c83cb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Lock "cinder-quobyte-dc04bbb9-4cd0-4936-ba22-658ab18c83cb" acquired by "delete_volume" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abe49fe-0eee-4bf5-b36a-ccacd8c72753]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:46 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb Jul 06 15:44:46 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:47 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259" returned: 0 in 0.950s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:47 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259 Jul 06 15:44:47 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:47 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:47 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb Jul 06 15:44:47 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:47 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4fd10f29-15d8-4d88-ab5b-9858f1da1259" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-4fd10f29-15d8-4d88-ab5b-9858f1da1259" released by "delete_volume" :: held 1.684s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Created reservations ['4fedfd2e-8b72-4d63-869a-ec8fee7c024a', '14237429-de7a-4813-9be9-859453b76b35', '6c0953e1-c020-4de7-bcc9-c264a327471c', 'c7622a89-d7c0-4cac-8ac9-56ae9e4fb714'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:47 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:47 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:48 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dc04bbb9-4cd0-4936-ba22-658ab18c83cb" returned: 0 in 0.752s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Lock "cinder-quobyte-dc04bbb9-4cd0-4936-ba22-658ab18c83cb" released by "delete_volume" :: held 1.633s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "cinder-quobyte-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Created reservations ['d6cd8f81-1a87-4dea-8651-eb10be200d26', 'd804d1c4-29fa-4be0-a918-885ec0b75d08', 'e8393c7b-5a39-4c7a-b6f9-d08dbc53ee20', '9a6b808a-f3fc-468b-bb9d-ddbfde71000c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe2761b-0145-49d2-898a-a9ad2522d13b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:48 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:48 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:48 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 Jul 06 15:44:48 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:48 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.857s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Deleted volume successfully. Jul 06 15:44:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-710fbf7c-1ea1-4db0-a97f-1316f86caa66 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-4fd10f29-15d8-4d88-ab5b-9858f1da1259-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:49 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.926s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:49 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Deleted volume successfully. Jul 06 15:44:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d2f3368d-d6dd-4326-9675-a917c626b61e tempest-ProjectReaderTests-1605983496 None] Lock "cinder-dc04bbb9-4cd0-4936-ba22-658ab18c83cb-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:49 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0" returned: 0 in 1.149s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:49 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0 Jul 06 15:44:49 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:50 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0" returned: 0 in 0.705s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-quobyte-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0" released by "delete_volume" :: held 1.923s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Created reservations ['116734d0-c650-45d3-be17-cd02493c1a32', 'be49daa0-db51-42c7-bfdb-2e53e7a86857', '959edb74-0922-42d7-917f-d17a1ba2c5ae', 'aa9a2a84-b9fb-4a52-973b-909661fd17c3'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:50 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:44:50 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:51 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.931s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:51 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:44:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Deleted volume successfully. Jul 06 15:44:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c9a4a4d-7d1d-4794-98fe-c6e6eeed3342 tempest-CreateVolumesFromImageTest-39990344 None] Lock "cinder-55ec2a0d-7fa0-46ed-8e32-f67e71e406a0-delete_volume" released by "delete_volume" :: held 3.189s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (009e6f6c-c9ad-4154-b70a-228478c6850c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01605724-4a48-4c36-82b4-99deb11283ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01605724-4a48-4c36-82b4-99deb11283ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960489633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0935b0-3042-442d-a3f0-534a391e4638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:54Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24415a8a-bbe7-4c53-ac9a-305cbd217656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24415a8a-bbe7-4c53-ac9a-305cbd217656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee72be7-b376-4313-8052-ac2d5c38ab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee72be7-b376-4313-8052-ac2d5c38ab7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc0935b0-3042-442d-a3f0-534a391e4638', 'volume_name': 'volume-fc0935b0-3042-442d-a3f0-534a391e4638', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299e1130-afe1-4c99-bffc-27e6e5f14ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299e1130-afe1-4c99-bffc-27e6e5f14ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e464bde5-302b-47b6-99dd-e6f50011fb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:53 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume fc0935b0-3042-442d-a3f0-534a391e4638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc0935b0-3042-442d-a3f0-534a391e4638', 'volume_size': 1} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-960489633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc0935b0-3042-442d-a3f0-534a391e4638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:44:54Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating volume fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:44:53 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:44:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:53 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 1073741824 Jul 06 15:44:53 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:54 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 1073741824" returned: 0 in 0.780s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:54 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 Jul 06 15:44:54 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:55 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638" returned: 0 in 0.612s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e464bde5-302b-47b6-99dd-e6f50011fb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc0935b0-3042-442d-a3f0-534a391e4638', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f483e7-4a0a-4331-a9b0-b5e939bf8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:44:55 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume volume-fc0935b0-3042-442d-a3f0-534a391e4638 (fc0935b0-3042-442d-a3f0-534a391e4638): created successfully Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8f483e7-4a0a-4331-a9b0-b5e939bf8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (009e6f6c-c9ad-4154-b70a-228478c6850c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:44:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7348f23c-60e1-4f3d-8735-417c18284ff4 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created volume successfully. Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating offline snapshot 97daabb7-41de-430f-bc90-14cc30b91fba of volume fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf73411-586f-47df-bf24-41a58d87b6f6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:44:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:55 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 Jul 06 15:44:55 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:56 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638" returned: 0 in 0.738s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:56 devstack sudo[103835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba 1G Jul 06 15:44:56 devstack sudo[103835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:57 devstack sudo[103835]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba 1G" returned: 0 in 0.757s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0935b0-3042-442d-a3f0-534a391e4638 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:57 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0935b0-3042-442d-a3f0-534a391e4638 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba Jul 06 15:44:57 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:58 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc0935b0-3042-442d-a3f0-534a391e4638 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba" returned: 0 in 0.690s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:58 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba is being set with open permissions: ugo+rw Jul 06 15:44:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:58 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba Jul 06 15:44:58 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:58 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba" returned: 0 in 0.625s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:58 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info Jul 06 15:44:58 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:59 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info" returned: 0 in 0.618s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:59 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info is being set with open permissions: ugo+rw Jul 06 15:44:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:44:59 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info Jul 06 15:44:59 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:44:59 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 06 15:44:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.info" returned: 0 in 0.601s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:44:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.106s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:44:59 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7c4457a8-4be1-4b57-94e1-dc31c322db51 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Create snapshot completed successfully Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (577badc1-e8c3-4bd3-86d2-20a54c7784e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0413993-b248-4de9-9ac5-200f23e23de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0413993-b248-4de9-9ac5-200f23e23de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-390012378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7be3a2d-06c0-45b2-becf-96948e244477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:01Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eb4085-7a67-4195-94d4-c07aa606fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eb4085-7a67-4195-94d4-c07aa606fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d22d59-a371-4255-8469-ce9ca8412be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d22d59-a371-4255-8469-ce9ca8412be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7be3a2d-06c0-45b2-becf-96948e244477', 'volume_name': 'volume-c7be3a2d-06c0-45b2-becf-96948e244477', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f31d51-414d-433e-aeff-b903d051ae63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f31d51-414d-433e-aeff-b903d051ae63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804f073c-96f5-4a52-94ae-d81b032e487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume c7be3a2d-06c0-45b2-becf-96948e244477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7be3a2d-06c0-45b2-becf-96948e244477', 'volume_size': 1} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-390012378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7be3a2d-06c0-45b2-becf-96948e244477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:01Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating volume c7be3a2d-06c0-45b2-becf-96948e244477 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:01 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:01 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 1073741824 Jul 06 15:45:01 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (6c47c28c-219d-4189-939b-d624be003afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2825f8-6569-45cd-8150-92a59b3c736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2825f8-6569-45cd-8150-92a59b3c736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071751230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2ddd14-c714-4121-b051-f58b020f7327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:02Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d14df3c-53c0-47ce-a4b0-ae43ef3a25e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d14df3c-53c0-47ce-a4b0-ae43ef3a25e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db161be4-aed0-4281-9b39-11828f7c1449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db161be4-aed0-4281-9b39-11828f7c1449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2ddd14-c714-4121-b051-f58b020f7327', 'volume_name': 'volume-8f2ddd14-c714-4121-b051-f58b020f7327', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5501813a-41c0-4e28-bddd-fed3ded3f6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5501813a-41c0-4e28-bddd-fed3ded3f6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3d46d6-b1bc-4cd9-990d-f7f7b39e51bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume 8f2ddd14-c714-4121-b051-f58b020f7327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2ddd14-c714-4121-b051-f58b020f7327', 'volume_size': 1} Jul 06 15:45:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (909a8506-375a-4feb-89d7-1dbb1c1faebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2feb0814-9ce0-4a27-ac8d-25b66b8cf36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2feb0814-9ce0-4a27-ac8d-25b66b8cf36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585339204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769778ae-99db-4961-a444-abfe910a8dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:02Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b95aca-84b5-4767-a1a1-c92abcfe3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b95aca-84b5-4767-a1a1-c92abcfe3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf01410-b22b-442b-a9e0-48bb9e532d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf01410-b22b-442b-a9e0-48bb9e532d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '769778ae-99db-4961-a444-abfe910a8dfe', 'volume_name': 'volume-769778ae-99db-4961-a444-abfe910a8dfe', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a43305-f0c2-4098-8b7f-d5120ca0d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a43305-f0c2-4098-8b7f-d5120ca0d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d8e95c-a960-42cf-beda-442168ad614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume 769778ae-99db-4961-a444-abfe910a8dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-769778ae-99db-4961-a444-abfe910a8dfe', 'volume_size': 1} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:02 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 1073741824" returned: 0 in 0.908s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:02 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 Jul 06 15:45:02 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (e12e6cfa-077a-49f4-bea9-0cd9c372cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5bd7f4-cdc3-40b9-ac07-fd0ee4607160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5bd7f4-cdc3-40b9-ac07-fd0ee4607160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8534116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ad70fd-c182-424a-8784-53ae8a8c72e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:02Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db49a3b0-db28-4396-81ed-386381aa98fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db49a3b0-db28-4396-81ed-386381aa98fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ded7359-bb82-4a58-a869-d8dcdc1bd7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ded7359-bb82-4a58-a869-d8dcdc1bd7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ad70fd-c182-424a-8784-53ae8a8c72e2', 'volume_name': 'volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14fba6-8e97-4f9f-bf12-9536eb941e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa14fba6-8e97-4f9f-bf12-9536eb941e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2ba841-1c0a-496b-ad47-c321df4270cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume c4ad70fd-c182-424a-8784-53ae8a8c72e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2', 'volume_size': 1} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (eed9a3cf-c062-4802-a857-ceb6b74b142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9827a53-cb60-4c27-9db6-334679f9dace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9827a53-cb60-4c27-9db6-334679f9dace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861080362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c11f1ca-81db-4e63-9dd7-877919cb678d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:03Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8732e64-03f8-4803-b21a-12eb24199b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8732e64-03f8-4803-b21a-12eb24199b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cf6b62-c403-4f90-ab33-c10074f30132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87cf6b62-c403-4f90-ab33-c10074f30132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c11f1ca-81db-4e63-9dd7-877919cb678d', 'volume_name': 'volume-4c11f1ca-81db-4e63-9dd7-877919cb678d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ccf86f-b391-4208-9cdb-c2561ff825f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ccf86f-b391-4208-9cdb-c2561ff825f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79db49e3-73c3-4b96-96e9-c8ef12867ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume 4c11f1ca-81db-4e63-9dd7-877919cb678d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c11f1ca-81db-4e63-9dd7-877919cb678d', 'volume_size': 1} Jul 06 15:45:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:03 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477" returned: 0 in 0.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2071751230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2ddd14-c714-4121-b051-f58b020f7327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:02Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating volume 8f2ddd14-c714-4121-b051-f58b020f7327 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804f073c-96f5-4a52-94ae-d81b032e487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7be3a2d-06c0-45b2-becf-96948e244477', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:03 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 1073741824 Jul 06 15:45:03 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d10bbf-79e4-4d24-88a0-9e1798c22593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume volume-c7be3a2d-06c0-45b2-becf-96948e244477 (c7be3a2d-06c0-45b2-becf-96948e244477): created successfully Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d10bbf-79e4-4d24-88a0-9e1798c22593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (577badc1-e8c3-4bd3-86d2-20a54c7784e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:03 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-dae93e7c-0521-467b-ab45-0d907e07b1fc tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created volume successfully. Jul 06 15:45:03 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 1073741824" returned: 0 in 0.798s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:04 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 Jul 06 15:45:04 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:04 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.399s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-585339204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769778ae-99db-4961-a444-abfe910a8dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:02Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating volume 769778ae-99db-4961-a444-abfe910a8dfe {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:04 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3d46d6-b1bc-4cd9-990d-f7f7b39e51bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2ddd14-c714-4121-b051-f58b020f7327', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:04 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe 1073741824 Jul 06 15:45:04 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c213b225-88b8-4226-9c11-dde36e50b89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume volume-8f2ddd14-c714-4121-b051-f58b020f7327 (8f2ddd14-c714-4121-b051-f58b020f7327): created successfully Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c213b225-88b8-4226-9c11-dde36e50b89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (6c47c28c-219d-4189-939b-d624be003afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3321f3ad-b379-4dbe-bd4a-2a7c45274ae8 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created volume successfully. Jul 06 15:45:05 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe 1073741824" returned: 0 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:05 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe Jul 06 15:45:05 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:06 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe" returned: 0 in 0.636s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.430s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-8534116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ad70fd-c182-424a-8784-53ae8a8c72e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:02Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating volume c4ad70fd-c182-424a-8784-53ae8a8c72e2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:06 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:06 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 1073741824 Jul 06 15:45:06 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d8e95c-a960-42cf-beda-442168ad614a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769778ae-99db-4961-a444-abfe910a8dfe', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bc7123-eaa9-41d2-87a6-acb66a560244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume volume-769778ae-99db-4961-a444-abfe910a8dfe (769778ae-99db-4961-a444-abfe910a8dfe): created successfully Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96bc7123-eaa9-41d2-87a6-acb66a560244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (909a8506-375a-4feb-89d7-1dbb1c1faebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8c2e7be6-1c25-4835-b081-5bbdec430ffd tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created volume successfully. Jul 06 15:45:06 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 1073741824" returned: 0 in 0.763s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:06 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:06 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:06 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 Jul 06 15:45:06 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:07 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:07 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2" returned: 0 in 0.644s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.661s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.603s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861080362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c11f1ca-81db-4e63-9dd7-877919cb678d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a49023b0156a4286af79bebaf70aee8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:03Z,use_quota=True,user_id='107497117ba148a3b5a7b347b03f016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Creating volume 4c11f1ca-81db-4e63-9dd7-877919cb678d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:07 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:45:07 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d 1073741824 Jul 06 15:45:07 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2ba841-1c0a-496b-ad47-c321df4270cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1bde45-1156-423e-a03a-91a17f544c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:07 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 (c4ad70fd-c182-424a-8784-53ae8a8c72e2): created successfully Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1bde45-1156-423e-a03a-91a17f544c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (e12e6cfa-077a-49f4-bea9-0cd9c372cb05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:07 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-05833834-7a9b-44af-902a-91c6b84f30c3 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created volume successfully. Jul 06 15:45:08 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d 1073741824" returned: 0 in 0.858s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:08 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d Jul 06 15:45:08 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:09 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d" returned: 0 in 0.621s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79db49e3-73c3-4b96-96e9-c8ef12867ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c11f1ca-81db-4e63-9dd7-877919cb678d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0fd523-49a5-4367-8d76-46f14146c141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:09 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Volume volume-4c11f1ca-81db-4e63-9dd7-877919cb678d (4c11f1ca-81db-4e63-9dd7-877919cb678d): created successfully Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0fd523-49a5-4367-8d76-46f14146c141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Flow 'volume_create_manager' (eed9a3cf-c062-4802-a857-ceb6b74b142b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-69f63039-3ba6-4a5b-af03-214bbcbb72c6 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created volume successfully. Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-4c11f1ca-81db-4e63-9dd7-877919cb678d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-4c11f1ca-81db-4e63-9dd7-877919cb678d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-4c11f1ca-81db-4e63-9dd7-877919cb678d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-4c11f1ca-81db-4e63-9dd7-877919cb678d" acquired by "delete_volume" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a99825-b1aa-40c1-96c9-2ba4c06a1db2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:09 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d Jul 06 15:45:09 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:10 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d" returned: 0 in 0.739s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:10 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d Jul 06 15:45:10 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:10 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4c11f1ca-81db-4e63-9dd7-877919cb678d" returned: 0 in 0.633s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-4c11f1ca-81db-4e63-9dd7-877919cb678d" released by "delete_volume" :: held 1.409s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['5b20f0d1-564a-471d-ab5a-ba9346c55fa7', '0b63e36c-774b-4dc2-9dd3-e7b94dc0b0d1', 'cf1aad36-19c0-40a3-bc83-a54c13cfa236', '8c2abff3-5d36-456b-b9ba-3351dfeb6507'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:11 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:11 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:11 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:11 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleted volume successfully. Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c869ca8-2355-4276-bb95-f9f958c85a2f tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-4c11f1ca-81db-4e63-9dd7-877919cb678d-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-c4ad70fd-c182-424a-8784-53ae8a8c72e2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-c4ad70fd-c182-424a-8784-53ae8a8c72e2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-c4ad70fd-c182-424a-8784-53ae8a8c72e2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-c4ad70fd-c182-424a-8784-53ae8a8c72e2" acquired by "delete_volume" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b26e5e-4f09-404a-87f3-7867a309c220]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:11 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 Jul 06 15:45:11 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:12 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2" returned: 0 in 0.718s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:12 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2 Jul 06 15:45:12 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:13 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c4ad70fd-c182-424a-8784-53ae8a8c72e2" returned: 0 in 0.620s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-c4ad70fd-c182-424a-8784-53ae8a8c72e2" released by "delete_volume" :: held 1.374s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['431e4c31-beb9-400c-ba47-b0c864c3d2ce', 'baea19ee-3c48-40ac-bb52-afc553b2242d', 'f88e74e5-87b7-426d-8982-71e970f71dce', '0f4674d0-aa7b-481b-b0f9-235566899a13'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:13 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:13 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:13 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.599s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleted volume successfully. Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-64ad0179-e9d1-4813-84de-a0031e1eba82 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-c4ad70fd-c182-424a-8784-53ae8a8c72e2-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-769778ae-99db-4961-a444-abfe910a8dfe-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-769778ae-99db-4961-a444-abfe910a8dfe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-769778ae-99db-4961-a444-abfe910a8dfe" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-769778ae-99db-4961-a444-abfe910a8dfe" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea609b1a-9958-45f8-8298-3a15c0ca91c6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:14 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe Jul 06 15:45:14 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:14 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe" returned: 0 in 0.709s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:14 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe Jul 06 15:45:14 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:15 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-769778ae-99db-4961-a444-abfe910a8dfe" returned: 0 in 0.599s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-769778ae-99db-4961-a444-abfe910a8dfe" released by "delete_volume" :: held 1.344s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['87f8f515-ddb0-42aa-9ed2-1d5c81d145e8', '284f6975-9c91-4890-a33d-6576fd832acc', '880b013c-4346-4195-a43f-e941e60429b5', '1cefaf0a-472c-4415-8b8d-7ed2078c1468'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:15 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:15 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:15 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.599s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleted volume successfully. Jul 06 15:45:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-390e6337-db47-4522-867a-b212187249ef tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-769778ae-99db-4961-a444-abfe910a8dfe-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-8f2ddd14-c714-4121-b051-f58b020f7327-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-8f2ddd14-c714-4121-b051-f58b020f7327-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-8f2ddd14-c714-4121-b051-f58b020f7327" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-8f2ddd14-c714-4121-b051-f58b020f7327" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3635a55b-5061-4ab4-846d-bdae1b455f06]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:16 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 Jul 06 15:45:16 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:16 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:16 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327 Jul 06 15:45:16 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:17 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8f2ddd14-c714-4121-b051-f58b020f7327" returned: 0 in 0.637s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-8f2ddd14-c714-4121-b051-f58b020f7327" released by "delete_volume" :: held 1.383s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['3fecaade-a364-4847-a2dd-2f28a05d08bb', '6eaf3cff-3dbf-4a08-a48b-d3311c998610', 'a887b167-a8a3-4f80-8c47-a3216ed58a09', 'c01a328d-f9b3-42de-b226-23e31d369581'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:17 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:17 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:18 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.611s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:18 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleted volume successfully. Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-01e0f53c-4898-4c97-b989-f82846997660 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-8f2ddd14-c714-4121-b051-f58b020f7327-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-c7be3a2d-06c0-45b2-becf-96948e244477-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-c7be3a2d-06c0-45b2-becf-96948e244477-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-c7be3a2d-06c0-45b2-becf-96948e244477" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-c7be3a2d-06c0-45b2-becf-96948e244477" acquired by "delete_volume" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a59286-2847-4e8c-b9e4-b81d8080e859]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:18 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 Jul 06 15:45:18 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:19 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:19 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477 Jul 06 15:45:19 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:19 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7be3a2d-06c0-45b2-becf-96948e244477" returned: 0 in 0.606s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-c7be3a2d-06c0-45b2-becf-96948e244477" released by "delete_volume" :: held 1.350s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['a2e9681e-e3bf-4eb9-8016-e7d220d14ec2', '5b8f9592-ab98-43ac-9bb3-3d65d5cc2b9b', 'c4e57213-3586-42b5-b118-dc9bddcc748f', '4f241776-9f78-423c-b0a1-9c968d6f9796'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:19 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:19 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:20 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.607s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleted volume successfully. Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8d0b701f-eeea-42a8-bb34-a76d5dc1a5c9 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-c7be3a2d-06c0-45b2-becf-96948e244477-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-97daabb7-41de-430f-bc90-14cc30b91fba-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-97daabb7-41de-430f-bc90-14cc30b91fba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-fc0935b0-3042-442d-a3f0-534a391e4638" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-fc0935b0-3042-442d-a3f0-534a391e4638" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-97daabb7-41de-430f-bc90-14cc30b91fba" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-97daabb7-41de-430f-bc90-14cc30b91fba" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleting offline snapshot 97daabb7-41de-430f-bc90-14cc30b91fba of volume fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] snapshot_file for this snap is: volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bff882-004b-446f-98d5-6fa84304d30e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:20 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba Jul 06 15:45:20 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:21 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc0935b0-3042-442d-a3f0-534a391e4638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:45:21 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847d62d-d301-4b73-ada0-f783b79f3565]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:21 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 Jul 06 15:45:21 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:22 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638" returned: 0 in 0.724s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:22 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba Jul 06 15:45:22 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:22 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba" returned: 0 in 0.699s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:22 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba Jul 06 15:45:22 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:23 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638.97daabb7-41de-430f-bc90-14cc30b91fba" returned: 0 in 0.609s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-97daabb7-41de-430f-bc90-14cc30b91fba" released by "_delete_snapshot" :: held 2.836s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-fc0935b0-3042-442d-a3f0-534a391e4638" released by "delete_snapshot" :: held 2.856s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['fe8565d8-788e-44db-bea7-d082f653a1fb', '98510217-bd25-4506-b3ef-133a1393df7b', '548ba1e3-2f4e-4fac-a36f-bc85de34c232', '25805fb8-3fb6-420f-a5b3-bc803f83d42d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Delete snapshot completed successfully. Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1e885242-695f-422d-ba4c-bfb57494aee1 tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-97daabb7-41de-430f-bc90-14cc30b91fba-delete_snapshot" released by "delete_snapshot" :: held 2.973s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-fc0935b0-3042-442d-a3f0-534a391e4638-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-fc0935b0-3042-442d-a3f0-534a391e4638-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "cinder-quobyte-fc0935b0-3042-442d-a3f0-534a391e4638" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-fc0935b0-3042-442d-a3f0-534a391e4638" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[956df4e0-ff48-40ac-b640-ef66b234069b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:23 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 Jul 06 15:45:23 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:24 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:24 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638 Jul 06 15:45:24 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:25 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc0935b0-3042-442d-a3f0-534a391e4638" returned: 0 in 0.618s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-quobyte-fc0935b0-3042-442d-a3f0-534a391e4638" released by "delete_volume" :: held 1.392s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=201,cinder:DELETE=22,cinder:SELECT=139,cinder:INSERT=49 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Created reservations ['558a182f-4be3-4a03-925e-88544eeb4ba4', '0540d9a5-bfd2-4de2-b8a3-3eaa8d08fd99', '812019b4-2c73-41a9-b556-58daf5f6f679', 'c1c684d7-507e-49ee-9ad6-ae2369379f1d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:25 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:25 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:25 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.624s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Deleted volume successfully. Jul 06 15:45:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dc0251d3-7909-47f8-a25b-a8af0b208ada tempest-CreateVolumesFromSnapshotTest-1370914628 None] Lock "cinder-fc0935b0-3042-442d-a3f0-534a391e4638-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=134,cinder:UPDATE=223,cinder:INSERT=50,cinder:DELETE=15 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (14a712b5-9960-438d-b269-3503eedce246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70494c7f-bc7c-4453-9f94-cb834aa8d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70494c7f-bc7c-4453-9f94-cb834aa8d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778137950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313513b7-75db-486d-b410-8c0a1b8ff590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:33Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b74afa4-22e5-4e40-8bad-909b7eb0db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b74afa4-22e5-4e40-8bad-909b7eb0db11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2591138-3c37-4ba6-ab7d-3d1a7e27c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2591138-3c37-4ba6-ab7d-3d1a7e27c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313513b7-75db-486d-b410-8c0a1b8ff590', 'volume_name': 'volume-313513b7-75db-486d-b410-8c0a1b8ff590', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724cc510-1da9-4e83-819c-86c4cf695954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724cc510-1da9-4e83-819c-86c4cf695954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c89654-b68e-46fc-8041-392c1f0f8658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Volume 313513b7-75db-486d-b410-8c0a1b8ff590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313513b7-75db-486d-b410-8c0a1b8ff590', 'volume_size': 1} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-778137950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313513b7-75db-486d-b410-8c0a1b8ff590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:33Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Creating volume 313513b7-75db-486d-b410-8c0a1b8ff590 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:32 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:32 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 1073741824 Jul 06 15:45:32 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:33 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 1073741824" returned: 0 in 0.781s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:33 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 Jul 06 15:45:33 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:34 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590" returned: 0 in 0.597s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c89654-b68e-46fc-8041-392c1f0f8658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313513b7-75db-486d-b410-8c0a1b8ff590', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e531eb-4357-45d6-8f5d-65be184b1847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:34 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Volume volume-313513b7-75db-486d-b410-8c0a1b8ff590 (313513b7-75db-486d-b410-8c0a1b8ff590): created successfully Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e531eb-4357-45d6-8f5d-65be184b1847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (14a712b5-9960-438d-b269-3503eedce246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bed0a19c-6da1-469a-aaa8-0106dcfc9a63 tempest-ProjectReaderTests-1894775266 None] Created volume successfully. Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-313513b7-75db-486d-b410-8c0a1b8ff590-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-313513b7-75db-486d-b410-8c0a1b8ff590-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-quobyte-313513b7-75db-486d-b410-8c0a1b8ff590" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-313513b7-75db-486d-b410-8c0a1b8ff590" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[db618939-fcd6-4dfa-9eee-2342c03da70b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:35 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 Jul 06 15:45:35 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:35 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590" returned: 0 in 0.726s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:35 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590 Jul 06 15:45:35 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:36 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-313513b7-75db-486d-b410-8c0a1b8ff590" returned: 0 in 0.608s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-313513b7-75db-486d-b410-8c0a1b8ff590" released by "delete_volume" :: held 1.369s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Created reservations ['9a65b8e9-fc6e-4745-9c30-a3e32a0f248f', '7a08fc72-9c8c-499e-9eb8-0a98945b340b', 'ff13b306-fd8d-42fc-a402-3095e1820828', '12be6b18-e3da-4120-a6e8-031028f1860c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:36 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:36 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:37 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.592s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Deleted volume successfully. Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b1ede790-040e-4a76-8ef6-8d8635a436a3 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-313513b7-75db-486d-b410-8c0a1b8ff590-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (6657404e-4e01-48e1-b951-f5a800f557b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6f39ef-264e-49dd-b238-ccfb0cdfe5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad6f39ef-264e-49dd-b238-ccfb0cdfe5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586591592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5019f41-0b3a-43c9-b2d7-34f095894880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:38Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0946c880-2410-4d01-b766-3b68afa45ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0946c880-2410-4d01-b766-3b68afa45ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fbdc67-c74c-401d-b41e-8da7b90544f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fbdc67-c74c-401d-b41e-8da7b90544f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5019f41-0b3a-43c9-b2d7-34f095894880', 'volume_name': 'volume-f5019f41-0b3a-43c9-b2d7-34f095894880', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e3dd63-c8f3-41c5-ac2f-17417b73777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e3dd63-c8f3-41c5-ac2f-17417b73777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d44789-0193-43d8-ad83-d4ab85859a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:37 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Volume f5019f41-0b3a-43c9-b2d7-34f095894880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5019f41-0b3a-43c9-b2d7-34f095894880', 'volume_size': 1} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586591592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5019f41-0b3a-43c9-b2d7-34f095894880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:38Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Creating volume f5019f41-0b3a-43c9-b2d7-34f095894880 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:37 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:37 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 1073741824 Jul 06 15:45:37 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:38 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 1073741824" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:38 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 Jul 06 15:45:38 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:39 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880" returned: 0 in 0.614s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d44789-0193-43d8-ad83-d4ab85859a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5019f41-0b3a-43c9-b2d7-34f095894880', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d5b3a-43ec-402b-b258-70e7ba684f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:39 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Volume volume-f5019f41-0b3a-43c9-b2d7-34f095894880 (f5019f41-0b3a-43c9-b2d7-34f095894880): created successfully Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d5b3a-43ec-402b-b258-70e7ba684f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (6657404e-4e01-48e1-b951-f5a800f557b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e3fac885-d098-4cc6-b8ab-635d1d5ee156 tempest-ProjectReaderTests-1894775266 None] Created volume successfully. Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-f5019f41-0b3a-43c9-b2d7-34f095894880-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-f5019f41-0b3a-43c9-b2d7-34f095894880-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-quobyte-f5019f41-0b3a-43c9-b2d7-34f095894880" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-f5019f41-0b3a-43c9-b2d7-34f095894880" acquired by "delete_volume" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6873769-a56b-40fb-b006-16ea2e2c18b6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:39 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 Jul 06 15:45:39 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:40 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880" returned: 0 in 0.709s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:40 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880 Jul 06 15:45:40 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:41 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5019f41-0b3a-43c9-b2d7-34f095894880" returned: 0 in 0.612s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-f5019f41-0b3a-43c9-b2d7-34f095894880" released by "delete_volume" :: held 1.360s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Created reservations ['98904952-5cbf-4453-90eb-91992c474759', 'cf9745f1-7d16-406d-a62b-b39c73153b21', '47124402-34d1-4696-8392-3b43eb69c556', 'bb607602-92c0-4ddd-9637-c2529c5187d0'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:41 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:41 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:41 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.625s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:41 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Deleted volume successfully. Jul 06 15:45:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-622cbe3f-59bb-4ec9-8042-cbaf503881c0 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-f5019f41-0b3a-43c9-b2d7-34f095894880-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (3ef5c466-33dd-497f-9e79-8520c820ff22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef6f519-163a-4335-bd20-b3bc39369296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ef6f519-163a-4335-bd20-b3bc39369296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218031405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9486408-c90b-44c6-be6d-0405fe17e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:42Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507c2bd4-a3cc-4176-b3f7-a550b5f22812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (507c2bd4-a3cc-4176-b3f7-a550b5f22812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0423144-5fe5-40eb-abd0-e9538dc13e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0423144-5fe5-40eb-abd0-e9538dc13e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9486408-c90b-44c6-be6d-0405fe17e567', 'volume_name': 'volume-e9486408-c90b-44c6-be6d-0405fe17e567', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62879d3e-88b6-40cf-a89b-3f2d1b555ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62879d3e-88b6-40cf-a89b-3f2d1b555ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e1d831-ca98-47f9-84e5-dd1bba58e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Volume e9486408-c90b-44c6-be6d-0405fe17e567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9486408-c90b-44c6-be6d-0405fe17e567', 'volume_size': 1} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218031405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9486408-c90b-44c6-be6d-0405fe17e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:42Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Creating volume e9486408-c90b-44c6-be6d-0405fe17e567 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:42 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:42 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 1073741824 Jul 06 15:45:42 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:43 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 1073741824" returned: 0 in 0.777s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:43 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 Jul 06 15:45:43 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:43 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567" returned: 0 in 0.610s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e1d831-ca98-47f9-84e5-dd1bba58e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9486408-c90b-44c6-be6d-0405fe17e567', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55444322-cf1a-49ae-bf93-291b39b68852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:43 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Volume volume-e9486408-c90b-44c6-be6d-0405fe17e567 (e9486408-c90b-44c6-be6d-0405fe17e567): created successfully Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55444322-cf1a-49ae-bf93-291b39b68852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:43 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (3ef5c466-33dd-497f-9e79-8520c820ff22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-918aa736-e1dd-4f39-958f-7d55d3b39264 tempest-ProjectReaderTests-1894775266 None] Created volume successfully. Jul 06 15:45:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-e9486408-c90b-44c6-be6d-0405fe17e567-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Lock "cinder-e9486408-c90b-44c6-be6d-0405fe17e567-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-quobyte-e9486408-c90b-44c6-be6d-0405fe17e567" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-e9486408-c90b-44c6-be6d-0405fe17e567" acquired by "delete_volume" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d6cf5f-a430-41b6-bc91-50182c6ec99a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:44 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 Jul 06 15:45:44 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:45 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567" returned: 0 in 0.712s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:45 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567 Jul 06 15:45:45 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:45 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-e9486408-c90b-44c6-be6d-0405fe17e567" returned: 0 in 0.612s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-e9486408-c90b-44c6-be6d-0405fe17e567" released by "delete_volume" :: held 1.358s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Created reservations ['57d90135-2efd-4cd9-9d07-e852030b9780', 'f6c356cf-46b4-4c5d-b03c-e135df74ba1e', 'b12a7d56-4fa9-4459-bf15-26db86c11d9e', 'ebc20968-4682-4a3f-9456-4a6abebad220'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:45 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:45 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:46 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.610s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:46 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Deleted volume successfully. Jul 06 15:45:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8f8d1e77-1128-4d07-9a31-2ce84539d4ee tempest-ProjectReaderTests-1894775266 None] Lock "cinder-e9486408-c90b-44c6-be6d-0405fe17e567-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (3639ebbd-08cc-4bea-9cb5-788183b391ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937027c4-ac5b-46d6-a0cc-8953ceaa69c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (937027c4-ac5b-46d6-a0cc-8953ceaa69c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189024789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1154adda-3c82-4a79-a8a8-8a8ea24e95c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:47Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf604c2-af64-4cd2-a378-fdbb893132c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbf604c2-af64-4cd2-a378-fdbb893132c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3d0068-102e-42cb-8fd2-4249439e02c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3d0068-102e-42cb-8fd2-4249439e02c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1154adda-3c82-4a79-a8a8-8a8ea24e95c1', 'volume_name': 'volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181987d0-5cb4-4e11-9c53-269bb72214e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (181987d0-5cb4-4e11-9c53-269bb72214e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c7d911-e4b6-4b23-934a-86ca00e30174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Volume 1154adda-3c82-4a79-a8a8-8a8ea24e95c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1', 'volume_size': 1} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-189024789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1154adda-3c82-4a79-a8a8-8a8ea24e95c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9aa99eb19cef4596b737f91683d40ccf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:45:47Z,use_quota=True,user_id='9826ad74c3a94f9897ceecbed64377ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Creating volume 1154adda-3c82-4a79-a8a8-8a8ea24e95c1 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:45:47 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:47 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 1073741824 Jul 06 15:45:47 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:47 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 1073741824" returned: 0 in 0.775s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:47 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 Jul 06 15:45:47 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:48 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1" returned: 0 in 0.598s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c7d911-e4b6-4b23-934a-86ca00e30174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1bd805-e6ca-4b8a-8a78-96df0801ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:45:48 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Volume volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 (1154adda-3c82-4a79-a8a8-8a8ea24e95c1): created successfully Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1bd805-e6ca-4b8a-8a78-96df0801ed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:45:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Flow 'volume_create_manager' (3639ebbd-08cc-4bea-9cb5-788183b391ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:45:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7604cbad-a81f-40a1-a25e-050d96e24a60 tempest-ProjectReaderTests-1894775266 None] Created volume successfully. Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-1154adda-3c82-4a79-a8a8-8a8ea24e95c1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-1154adda-3c82-4a79-a8a8-8a8ea24e95c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "cinder-quobyte-1154adda-3c82-4a79-a8a8-8a8ea24e95c1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-1154adda-3c82-4a79-a8a8-8a8ea24e95c1" acquired by "delete_volume" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3410be-07df-4e7c-ad16-cc146f22d062]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:49 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 Jul 06 15:45:49 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:49 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1" returned: 0 in 0.735s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:49 devstack sudo[104108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1 Jul 06 15:45:49 devstack sudo[104108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:50 devstack sudo[104108]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1154adda-3c82-4a79-a8a8-8a8ea24e95c1" returned: 0 in 0.618s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-quobyte-1154adda-3c82-4a79-a8a8-8a8ea24e95c1" released by "delete_volume" :: held 1.392s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Created reservations ['a9ed5a9f-f57d-439c-a410-5baeaa839783', '0d0a4191-02a8-43dc-a4a1-7a73fcd2e9fb', 'f7d67a80-c07c-47bd-83ef-e94faea22b95', 'e495c19b-9124-4c49-a1ac-79dd7a5baae7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:45:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:45:50 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:45:50 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:45:51 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 06 15:45:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.612s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:45:51 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:45:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Deleted volume successfully. Jul 06 15:45:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-211dbe31-0a37-4bd6-9103-8967b5263631 tempest-ProjectReaderTests-1894775266 None] Lock "cinder-1154adda-3c82-4a79-a8a8-8a8ea24e95c1-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:00 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=44,cinder:INSERT=12,cinder:SELECT=26,cinder:DELETE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:46:01 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:INSERT=10,cinder:UPDATE=49,cinder:SELECT=31,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (cf8763d4-6069-47f2-a971-84151854f0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cdc9e2-c4d6-4837-80a7-0f0ca3763a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cdc9e2-c4d6-4837-80a7-0f0ca3763a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-118780812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0084ec9-d53e-4527-b01e-ca11f328c5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:03Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa165cb-9210-4ea0-a541-07594dd3e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa165cb-9210-4ea0-a541-07594dd3e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23895901-2784-4c8f-950b-00e3da5006f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23895901-2784-4c8f-950b-00e3da5006f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0084ec9-d53e-4527-b01e-ca11f328c5d1', 'volume_name': 'volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16df825-4394-485a-b9c2-9fc68d53c2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16df825-4394-485a-b9c2-9fc68d53c2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84329ebd-9b85-411d-83f7-05fbfeb09040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:02 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume d0084ec9-d53e-4527-b01e-ca11f328c5d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1', 'volume_size': 1} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-118780812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0084ec9-d53e-4527-b01e-ca11f328c5d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:03Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating volume d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:02 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:02 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 1073741824 Jul 06 15:46:02 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (e220f157-f074-4e83-b428-49776f6d1773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:02 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5165ee7-7bf4-4d69-8df0-5a685039d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5165ee7-7bf4-4d69-8df0-5a685039d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942227596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5541b97d-e507-4d35-bab4-8b47a0c2cdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:03Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50b8fb9-b64d-44b0-a778-93125ed50679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50b8fb9-b64d-44b0-a778-93125ed50679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39f159b-d240-4b98-917a-9d0019e9745a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39f159b-d240-4b98-917a-9d0019e9745a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5541b97d-e507-4d35-bab4-8b47a0c2cdb0', 'volume_name': 'volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39701bc7-25b5-4907-8f2c-c7e5c78c9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39701bc7-25b5-4907-8f2c-c7e5c78c9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54949a26-a17f-4b60-aee8-fff187eb9301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume 5541b97d-e507-4d35-bab4-8b47a0c2cdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0', 'volume_size': 1} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Flow 'volume_create_manager' (ecb4b47a-a934-4037-b1d2-735f99fc0d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e5d35e-678c-478e-8d4d-3e355f1731fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e5d35e-678c-478e-8d4d-3e355f1731fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1429405316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649d9f3f-b0dd-47a9-92d5-84886a447db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aeea32416574c43a08b784b9012a878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:03Z,use_quota=True,user_id='b1c1fdd5f9dc45238c07084cbc1db5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7551a8fa-3097-4bb6-8d86-261f8aa4dae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7551a8fa-3097-4bb6-8d86-261f8aa4dae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77332ff5-288e-4b2f-bfb7-3bd23e1b0dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77332ff5-288e-4b2f-bfb7-3bd23e1b0dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649d9f3f-b0dd-47a9-92d5-84886a447db8', 'volume_name': 'volume-649d9f3f-b0dd-47a9-92d5-84886a447db8', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc934030-386f-4b11-98cf-503d29ede326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc934030-386f-4b11-98cf-503d29ede326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0a0515-1e47-4160-97d9-66e69e0da161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Volume 649d9f3f-b0dd-47a9-92d5-84886a447db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649d9f3f-b0dd-47a9-92d5-84886a447db8', 'volume_size': 1} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:03 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 1073741824" returned: 0 in 1.010s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:03 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 Jul 06 15:46:03 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:04 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1" returned: 0 in 0.665s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942227596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5541b97d-e507-4d35-bab4-8b47a0c2cdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:03Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Creating volume 5541b97d-e507-4d35-bab4-8b47a0c2cdb0 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:04 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:04 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 1073741824 Jul 06 15:46:04 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84329ebd-9b85-411d-83f7-05fbfeb09040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b22855-41b4-42e7-a202-a998a6faa065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 (d0084ec9-d53e-4527-b01e-ca11f328c5d1): created successfully Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b22855-41b4-42e7-a202-a998a6faa065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (cf8763d4-6069-47f2-a971-84151854f0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-204ac374-2e46-4310-8380-6187daea6c4f tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created volume successfully. Jul 06 15:46:05 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 1073741824" returned: 0 in 0.876s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:05 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 Jul 06 15:46:05 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:06 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0" returned: 0 in 0.681s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.748s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1429405316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649d9f3f-b0dd-47a9-92d5-84886a447db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aeea32416574c43a08b784b9012a878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:03Z,use_quota=True,user_id='b1c1fdd5f9dc45238c07084cbc1db5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Creating volume 649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:06 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54949a26-a17f-4b60-aee8-fff187eb9301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 1073741824 Jul 06 15:46:06 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0b3304-cd19-4368-b043-8a0609379a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 (5541b97d-e507-4d35-bab4-8b47a0c2cdb0): created successfully Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0b3304-cd19-4368-b043-8a0609379a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (e220f157-f074-4e83-b428-49776f6d1773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-10c53215-3d30-49ab-9709-ee1581709fff tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created volume successfully. Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Flow 'volume_create_manager' (f7db4759-fbfd-492a-a11a-96c5c1d8c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4308f4-0dd8-4262-94b9-2943978de7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4308f4-0dd8-4262-94b9-2943978de7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b18d05d-5db1-4d02-8d0c-397c8cfd39dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c0786a969409a99ce4f75b5559174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:06Z,use_quota=True,user_id='61c3ff35def64de6b9effbdc62c027d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d9e11d-04aa-4b60-83f7-7af4913d3e6b),volume_type_id=25d9e11d-04aa-4b60-83f7-7af4913d3e6b)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5619a5-c007-4df3-84b4-6c0d2814c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5619a5-c007-4df3-84b4-6c0d2814c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db662ec-9c25-4e34-8a78-86a7d3396cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db662ec-9c25-4e34-8a78-86a7d3396cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b18d05d-5db1-4d02-8d0c-397c8cfd39dc', 'volume_name': 'volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc', 'volume_size': 1, 'image_id': 'b3eda879-651e-436c-878b-50b25a030eee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3eda879-651e-436c-878b-50b25a030eee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b14549e6c5821a9aa177bb8941fdbdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b47c0786a969409a99ce4f75b5559174', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '340ad797c9dd58e3bd2808fc3a8df1672265fe44ff3b101651dcae0cd0eb045eebeb1c27c2a84c47c79cf6658c3c04e44ce722ddbc8f5d900270154f468bb8c0', 'id': 'b3eda879-651e-436c-878b-50b25a030eee', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3eda879-651e-436c-878b-50b25a030eee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cded68c-bd7f-4e1a-8663-cdcf1e163504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cded68c-bd7f-4e1a-8663-cdcf1e163504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcd6075-87ae-4f70-9c50-c0b8581b2445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Volume 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc', 'volume_size': 1, 'image_id': 'b3eda879-651e-436c-878b-50b25a030eee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3eda879-651e-436c-878b-50b25a030eee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b14549e6c5821a9aa177bb8941fdbdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b47c0786a969409a99ce4f75b5559174', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '340ad797c9dd58e3bd2808fc3a8df1672265fe44ff3b101651dcae0cd0eb045eebeb1c27c2a84c47c79cf6658c3c04e44ce722ddbc8f5d900270154f468bb8c0', 'id': 'b3eda879-651e-436c-878b-50b25a030eee', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3eda879-651e-436c-878b-50b25a030eee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Trying to clone 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc from image b3eda879-651e-436c-878b-50b25a030eee at location (None, [{'url': 'file:///opt/stack/data/glance/images/b3eda879-651e-436c-878b-50b25a030eee', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:46:06 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:46:06 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:06 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c3dd33-a045-44d3-9bbd-9778deabaa49]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:07 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD Jul 06 15:46:07 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:07 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 1073741824" returned: 0 in 1.070s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:07 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:07 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (3d9827ff-956f-4b47-a339-e5a9fe9608ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa428fe-5a38-4e67-b4b4-af786a9638fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa428fe-5a38-4e67-b4b4-af786a9638fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1319407717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd68f222-f13b-42d5-a487-685cb3b29013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:07Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8679e06a-0bcd-4b14-b6c0-1dbba2f1fc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8679e06a-0bcd-4b14-b6c0-1dbba2f1fc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561647d7-1881-480f-932a-c78a643caf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (561647d7-1881-480f-932a-c78a643caf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd68f222-f13b-42d5-a487-685cb3b29013', 'volume_name': 'volume-fd68f222-f13b-42d5-a487-685cb3b29013', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae60d2-6001-4b9f-934e-9da3710fa982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bae60d2-6001-4b9f-934e-9da3710fa982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1cab6a-7f0a-4195-acad-1fc7540077ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:07 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume fd68f222-f13b-42d5-a487-685cb3b29013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd68f222-f13b-42d5-a487-685cb3b29013', 'volume_size': 1} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:07 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD" returned: 0 in 1.034s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:07 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.141s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:46:08 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD Jul 06 15:46:08 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (4424c66b-8dae-4ac3-a741-4dc35a965209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb41e62-89fb-45b2-a02f-19cbe5410e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb41e62-89fb-45b2-a02f-19cbe5410e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-19153657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcba37a9-578f-49e3-9051-152b808d814f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:08Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9780ff1-3465-4129-bf39-881ebdc4aea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9780ff1-3465-4129-bf39-881ebdc4aea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9830f1d9-68ee-4be9-8206-ef97eb070007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9830f1d9-68ee-4be9-8206-ef97eb070007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcba37a9-578f-49e3-9051-152b808d814f', 'volume_name': 'volume-bcba37a9-578f-49e3-9051-152b808d814f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5564a5-7df9-4eee-a119-81be42b77c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5564a5-7df9-4eee-a119-81be42b77c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5d68b4-fc1d-4cfd-a265-0f045c3274d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume bcba37a9-578f-49e3-9051-152b808d814f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcba37a9-578f-49e3-9051-152b808d814f', 'volume_size': 1} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:08 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 1.036s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.368s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating offline snapshot a328fdf4-8f4e-434d-99fe-f420f63ca586 of volume d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b0a0515-1e47-4160-97d9-66e69e0da161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649d9f3f-b0dd-47a9-92d5-84886a447db8', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042f9eb1-eecf-4e5d-9413-b715636f6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb05a84-f81a-4d7c-b267-ade9e3d8c6fb]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Volume volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 (649d9f3f-b0dd-47a9-92d5-84886a447db8): created successfully Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042f9eb1-eecf-4e5d-9413-b715636f6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Flow 'volume_create_manager' (ecb4b47a-a934-4037-b1d2-735f99fc0d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7a3df4f4-782a-477e-a263-3bb5ea92ed4c tempest-VolumeDependencyTests-1221436542 None] Created volume successfully. Jul 06 15:46:08 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 Jul 06 15:46:08 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (b0e88c9b-0a1b-43a8-ba18-f94cc4ecbc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7ef778-4644-4662-84f0-98e15842c8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7ef778-4644-4662-84f0-98e15842c8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053240914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41868b40-3f1d-4c33-9b02-2e6fe072dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:09Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a386d756-460b-493c-9d39-1c91d1637de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a386d756-460b-493c-9d39-1c91d1637de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06093a75-8c21-4f23-a0b3-6ece86f12195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06093a75-8c21-4f23-a0b3-6ece86f12195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41868b40-3f1d-4c33-9b02-2e6fe072dcc5', 'volume_name': 'volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d39dcad-a060-47fe-80e0-c6a2f63d6f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d39dcad-a060-47fe-80e0-c6a2f63d6f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2291f1-575d-41bd-9f93-0398e6c95b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume 41868b40-3f1d-4c33-9b02-2e6fe072dcc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5', 'volume_size': 1} Jul 06 15:46:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:09 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD" returned: 1 in 1.134s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Temporary image b3eda879-651e-436c-878b-50b25a030eee is fetched for user 61c3ff35def64de6b9effbdc62c027d3. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a758a34-3598-47bf-8a9d-f13223e33996]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (1dbfb058-7ff4-4dee-ba5b-536cfdc26ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb3192c-0658-4d29-9f1c-fe49adcffd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD Jul 06 15:46:09 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb3192c-0658-4d29-9f1c-fe49adcffd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874138902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba7b209-de3a-47c3-90cc-62c090414d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:09Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73018eb-a5bc-48df-b9d6-86400e48b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73018eb-a5bc-48df-b9d6-86400e48b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4431bf-9371-4f87-acd3-40d0eda4df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4431bf-9371-4f87-acd3-40d0eda4df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba7b209-de3a-47c3-90cc-62c090414d49', 'volume_name': 'volume-dba7b209-de3a-47c3-90cc-62c090414d49', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7448ab-cb0d-4f7a-a888-7514743490dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7448ab-cb0d-4f7a-a888-7514743490dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc2b2a-251c-49be-96e6-e019793fb32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume dba7b209-de3a-47c3-90cc-62c090414d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba7b209-de3a-47c3-90cc-62c090414d49', 'volume_size': 1} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:09 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1" returned: 0 in 1.060s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:09 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 1G Jul 06 15:46:09 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (25f07d63-60b9-4e52-8228-15179c825d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf77a8b-74f3-4365-9cce-7689ed023344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf77a8b-74f3-4365-9cce-7689ed023344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-240226087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e116bb-1340-4999-9808-87d9f6fa0ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:10Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac1e419-9d09-48f0-a121-037d62d4c3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac1e419-9d09-48f0-a121-037d62d4c3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58890b05-9c02-4fbb-b29b-9194675cde47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58890b05-9c02-4fbb-b29b-9194675cde47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e116bb-1340-4999-9808-87d9f6fa0ebe', 'volume_name': 'volume-63e116bb-1340-4999-9808-87d9f6fa0ebe', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea943b0-7a4d-4cd3-b4ca-69dcbacdbd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea943b0-7a4d-4cd3-b4ca-69dcbacdbd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f81b3d5-5c19-4b96-a9ea-2780181e3c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:09 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume 63e116bb-1340-4999-9808-87d9f6fa0ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e116bb-1340-4999-9808-87d9f6fa0ebe', 'volume_size': 1} Jul 06 15:46:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:10 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:10 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD Jul 06 15:46:10 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:10 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 1G" returned: 0 in 0.900s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:10 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 Jul 06 15:46:10 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:10 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD" returned: 1 in 0.802s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:11 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:11 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 is being set with open permissions: ugo+rw Jul 06 15:46:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:11 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 Jul 06 15:46:11 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:11 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586" returned: 0 in 0.646s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:11 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info Jul 06 15:46:11 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:12 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info" returned: 0 in 0.656s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:12 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info is being set with open permissions: ugo+rw Jul 06 15:46:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:12 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info Jul 06 15:46:12 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:13 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.info" returned: 0 in 0.632s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.735s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.390s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1319407717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd68f222-f13b-42d5-a487-685cb3b29013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:07Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Creating volume fd68f222-f13b-42d5-a487-685cb3b29013 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:13 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:13 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 1073741824 Jul 06 15:46:13 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-05996339-f7f1-4082-8852-144386a26671 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Create snapshot completed successfully Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (52932f41-bb64-4857-9f73-6fb6049b5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6baabd-754d-4173-bc94-52c566093820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6baabd-754d-4173-bc94-52c566093820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279397898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569131a5-a98b-499e-8aaa-a7da890cd8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:14Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a292de79-c613-4935-a16b-2b81b34c874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a292de79-c613-4935-a16b-2b81b34c874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4720efd8-9fc8-4a93-954e-27aa18ac22ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4720efd8-9fc8-4a93-954e-27aa18ac22ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569131a5-a98b-499e-8aaa-a7da890cd8b9', 'volume_name': 'volume-569131a5-a98b-499e-8aaa-a7da890cd8b9', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a0bd38-bd70-45b1-9e57-0c5d7e61aa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a0bd38-bd70-45b1-9e57-0c5d7e61aa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3823735-fec6-47c5-a13d-8575d78b5083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:13 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume 569131a5-a98b-499e-8aaa-a7da890cd8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569131a5-a98b-499e-8aaa-a7da890cd8b9', 'volume_size': 1} Jul 06 15:46:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 1073741824" returned: 0 in 0.926s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:14 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 Jul 06 15:46:14 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (d0059249-ffe7-474c-b6c7-2621ac66c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda2b1d4-8901-4f8c-bf52-e4a73533fbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda2b1d4-8901-4f8c-bf52-e4a73533fbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657500648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3947f8d8-6416-43dd-b11c-0b514f95ca5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:14Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f194dcd-d943-4c96-aa66-94093e58aa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f194dcd-d943-4c96-aa66-94093e58aa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec963d7-2e4c-45db-a22a-cac8a10fc5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec963d7-2e4c-45db-a22a-cac8a10fc5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3947f8d8-6416-43dd-b11c-0b514f95ca5f', 'volume_name': 'volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be09d6c3-b4aa-42ad-b6de-2a1b9b95cf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be09d6c3-b4aa-42ad-b6de-2a1b9b95cf2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6be6f2-4199-4234-89c0-c6ccb1a56177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume 3947f8d8-6416-43dd-b11c-0b514f95ca5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f', 'volume_size': 1} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (b62313b4-f4b9-4cca-9cfa-44b7aafcf51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053e19c9-4553-4e4c-9d97-265cddc3434b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053e19c9-4553-4e4c-9d97-265cddc3434b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-163594881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfe0b73-7bc4-41fb-a435-3d6be699f4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee80ecfd-0706-4b40-9f31-d6b689ce37b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee80ecfd-0706-4b40-9f31-d6b689ce37b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f726008-f92f-42ef-b954-53df419350dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f726008-f92f-42ef-b954-53df419350dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edfe0b73-7bc4-41fb-a435-3d6be699f4af', 'volume_name': 'volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e794dd-6d26-4097-9c98-2ad9571ab671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e794dd-6d26-4097-9c98-2ad9571ab671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc300bc5-f44c-40a9-8427-441e0c5306e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume edfe0b73-7bc4-41fb-a435-3d6be699f4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af', 'volume_size': 1} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013" returned: 0 in 0.711s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.455s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-19153657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcba37a9-578f-49e3-9051-152b808d814f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:08Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Creating volume bcba37a9-578f-49e3-9051-152b808d814f {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:14 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1cab6a-7f0a-4195-acad-1fc7540077ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd68f222-f13b-42d5-a487-685cb3b29013', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821084b0-9f3b-4dc6-9bc1-8a24e0185bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:14 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f 1073741824 Jul 06 15:46:14 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:14 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume volume-fd68f222-f13b-42d5-a487-685cb3b29013 (fd68f222-f13b-42d5-a487-685cb3b29013): created successfully Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821084b0-9f3b-4dc6-9bc1-8a24e0185bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:14 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (3d9827ff-956f-4b47-a339-e5a9fe9608ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:14 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9538dc31-f2ba-4bd0-b7f8-e7e4080bbdfb tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created volume successfully. Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (3dd09e95-158d-4054-a11a-653bbee1e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7596be95-171c-43c8-8848-178b5e8b54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7596be95-171c-43c8-8848-178b5e8b54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074892315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98df7a9d-93ae-4947-b2f1-da49bd1bd109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643b223a-7b3a-4daa-b024-9915b5ef6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643b223a-7b3a-4daa-b024-9915b5ef6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d524b18-eeda-4203-a7da-295cfb1a911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d524b18-eeda-4203-a7da-295cfb1a911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98df7a9d-93ae-4947-b2f1-da49bd1bd109', 'volume_name': 'volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abb6996-7178-4671-be62-43f86667eace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0abb6996-7178-4671-be62-43f86667eace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701c83c3-8ec8-4966-944f-5d370e667df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume 98df7a9d-93ae-4947-b2f1-da49bd1bd109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109', 'volume_size': 1} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (c0c20d92-d1fe-431a-96e3-b9b0f69a598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853846ec-7f89-4629-952f-f3aee0e3d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853846ec-7f89-4629-952f-f3aee0e3d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1505291792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1700f299-f0bb-46a5-9053-b3e261566509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74234acf-3c67-47ab-9549-94fc1287bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74234acf-3c67-47ab-9549-94fc1287bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751f3739-71a7-4c93-a522-6dcf76a8bdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (751f3739-71a7-4c93-a522-6dcf76a8bdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1700f299-f0bb-46a5-9053-b3e261566509', 'volume_name': 'volume-1700f299-f0bb-46a5-9053-b3e261566509', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640b3945-29e1-4373-8629-8d71fcc60080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640b3945-29e1-4373-8629-8d71fcc60080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8863bc63-4ec7-44f8-bc73-de66bbb68c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:15 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume 1700f299-f0bb-46a5-9053-b3e261566509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1700f299-f0bb-46a5-9053-b3e261566509', 'volume_size': 1} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:15 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f 1073741824" returned: 0 in 0.879s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:15 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f Jul 06 15:46:15 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:16 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f" returned: 0 in 0.620s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.411s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053240914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41868b40-3f1d-4c33-9b02-2e6fe072dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:09Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Creating volume 41868b40-3f1d-4c33-9b02-2e6fe072dcc5 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:16 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:16 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 1073741824 Jul 06 15:46:16 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5d68b4-fc1d-4cfd-a265-0f045c3274d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcba37a9-578f-49e3-9051-152b808d814f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed23406f-38dd-45be-9db0-a863c6166bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:16 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume volume-bcba37a9-578f-49e3-9051-152b808d814f (bcba37a9-578f-49e3-9051-152b808d814f): created successfully Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed23406f-38dd-45be-9db0-a863c6166bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (4424c66b-8dae-4ac3-a741-4dc35a965209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:16 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4fccde70-a1d9-4b3c-9305-975b9a2a959c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created volume successfully. Jul 06 15:46:17 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 1073741824" returned: 0 in 0.825s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:17 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 Jul 06 15:46:17 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:17 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5" returned: 0 in 0.621s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.551s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Creating offline snapshot 93a6952f-af7e-4e5d-beda-3f1fe9d40c27 of volume 649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b2291f1-575d-41bd-9f93-0398e6c95b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef9aa7-2293-467e-bafb-3262d7e4c385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a8f1d4-17b2-4a61-a2b6-db696f9c1ce8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:17 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 (41868b40-3f1d-4c33-9b02-2e6fe072dcc5): created successfully Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ef9aa7-2293-467e-bafb-3262d7e4c385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (b0e88c9b-0a1b-43a8-ba18-f94cc4ecbc86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:17 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-bda29a69-bd2f-43fe-a671-bad039b47bb4 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created volume successfully. Jul 06 15:46:18 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:18 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:18 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 0.785s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:18 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 1G Jul 06 15:46:18 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:19 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 1G" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:19 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 Jul 06 15:46:19 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:20 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27" returned: 0 in 0.661s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:20 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 is being set with open permissions: ugo+rw Jul 06 15:46:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:20 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 Jul 06 15:46:20 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:20 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:20 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info Jul 06 15:46:20 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:21 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:21 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info is being set with open permissions: ugo+rw Jul 06 15:46:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:21 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info Jul 06 15:46:21 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:21 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.info" returned: 0 in 0.597s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.130s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.546s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874138902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba7b209-de3a-47c3-90cc-62c090414d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:09Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Creating volume dba7b209-de3a-47c3-90cc-62c090414d49 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:22 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:22 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 1073741824 Jul 06 15:46:22 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-522c6a22-e5fa-452d-ad64-2a7578a18e2d tempest-VolumeDependencyTests-1221436542 None] Create snapshot completed successfully Jul 06 15:46:22 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 1073741824" returned: 0 in 0.857s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:22 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 Jul 06 15:46:22 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Flow 'volume_create_manager' (a0335c2d-3a6f-4f44-a92d-e73cea547504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41f299b-20c8-4249-8084-2ba4f5d7c982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41f299b-20c8-4249-8084-2ba4f5d7c982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-777898313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423ec01b-7a22-4a35-89a1-74f4352b71c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aeea32416574c43a08b784b9012a878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93a6952f-af7e-4e5d-beda-3f1fe9d40c27,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:23Z,use_quota=True,user_id='b1c1fdd5f9dc45238c07084cbc1db5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cd41c1-db62-496e-bd0d-7314e730bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cd41c1-db62-496e-bd0d-7314e730bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69de210-df89-460e-abb8-aa7040b8ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69de210-df89-460e-abb8-aa7040b8ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '423ec01b-7a22-4a35-89a1-74f4352b71c1', 'volume_name': 'volume-423ec01b-7a22-4a35-89a1-74f4352b71c1', 'volume_size': 1, 'snapshot_id': '93a6952f-af7e-4e5d-beda-3f1fe9d40c27'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1ad515-21e0-411f-b61b-737c4128be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe1ad515-21e0-411f-b61b-737c4128be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3feadf0-4017-40ec-bcbc-5b4a7a0433e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Volume 423ec01b-7a22-4a35-89a1-74f4352b71c1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-423ec01b-7a22-4a35-89a1-74f4352b71c1', 'volume_size': 1, 'snapshot_id': '93a6952f-af7e-4e5d-beda-3f1fe9d40c27'} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:23 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49" returned: 0 in 0.674s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.910s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-240226087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e116bb-1340-4999-9808-87d9f6fa0ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6e952798d344d2a3a25e0a96282c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:10Z,use_quota=True,user_id='dd64bcde6fea44afa8f3ffc5ec75ad03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Creating volume 63e116bb-1340-4999-9808-87d9f6fa0ebe {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:23 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:23 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe 1073741824 Jul 06 15:46:23 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc2b2a-251c-49be-96e6-e019793fb32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba7b209-de3a-47c3-90cc-62c090414d49', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047b2101-53f4-4a47-aca3-7d162fdacbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume volume-dba7b209-de3a-47c3-90cc-62c090414d49 (dba7b209-de3a-47c3-90cc-62c090414d49): created successfully Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047b2101-53f4-4a47-aca3-7d162fdacbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (1dbfb058-7ff4-4dee-ba5b-536cfdc26ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:23 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-038d933f-a4b0-4257-81dc-972c946c580e tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created volume successfully. Jul 06 15:46:24 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe 1073741824" returned: 0 in 0.830s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:24 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe Jul 06 15:46:24 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:25 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe" returned: 0 in 0.637s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.245s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b18d05d-5db1-4d02-8d0c-397c8cfd39dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47c0786a969409a99ce4f75b5559174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:06Z,use_quota=True,user_id='61c3ff35def64de6b9effbdc62c027d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25d9e11d-04aa-4b60-83f7-7af4913d3e6b),volume_type_id=25d9e11d-04aa-4b60-83f7-7af4913d3e6b)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Creating volume 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:25 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f81b3d5-5c19-4b96-a9ea-2780181e3c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e116bb-1340-4999-9808-87d9f6fa0ebe', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c343dc-9941-4074-9fc5-b3f7a5266bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:25 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc 1073741824 Jul 06 15:46:25 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:25 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Volume volume-63e116bb-1340-4999-9808-87d9f6fa0ebe (63e116bb-1340-4999-9808-87d9f6fa0ebe): created successfully Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c343dc-9941-4074-9fc5-b3f7a5266bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Flow 'volume_create_manager' (25f07d63-60b9-4e52-8228-15179c825d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cba2463b-a20b-44c4-9e91-08de52277add tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created volume successfully. Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-63e116bb-1340-4999-9808-87d9f6fa0ebe-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-63e116bb-1340-4999-9808-87d9f6fa0ebe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-quobyte-63e116bb-1340-4999-9808-87d9f6fa0ebe" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-63e116bb-1340-4999-9808-87d9f6fa0ebe" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf03549-8004-4423-bc22-9008e0531d0f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:25 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe Jul 06 15:46:25 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:25 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc 1073741824" returned: 0 in 0.845s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:26 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:26 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:26 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe" returned: 0 in 0.749s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:26 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe Jul 06 15:46:26 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:26 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 0 in 0.619s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.627s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-279397898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569131a5-a98b-499e-8aaa-a7da890cd8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:14Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating volume 569131a5-a98b-499e-8aaa-a7da890cd8b9 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:26 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:26 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 1073741824 Jul 06 15:46:26 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Attempting download of b3eda879-651e-436c-878b-50b25a030eee ((None, [{'url': 'file:///opt/stack/data/glance/images/b3eda879-651e-436c-878b-50b25a030eee', 'metadata': {}}])) to volume 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaa67be-cd4d-4995-842e-3ba38474345a]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:26 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d Jul 06 15:46:26 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:27 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-63e116bb-1340-4999-9808-87d9f6fa0ebe" returned: 0 in 0.727s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-63e116bb-1340-4999-9808-87d9f6fa0ebe" released by "delete_volume" :: held 1.522s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created reservations ['8a0c320b-11a5-46ca-93d7-5e86724c0571', '9a1cbe26-7345-47c8-88a2-2dde64a37a56', 'ec922e9e-2474-41ec-b740-557a14d3585e', 'e2be2ab9-d08d-41f7-ad30-b9bae228afed'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:27 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:27 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:27 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 1073741824" returned: 0 in 0.879s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:27 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d" returned: 0 in 0.805s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:27 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 Jul 06 15:46:27 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:27 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d Jul 06 15:46:27 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-dba7b209-de3a-47c3-90cc-62c090414d49-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-dba7b209-de3a-47c3-90cc-62c090414d49-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-quobyte-dba7b209-de3a-47c3-90cc-62c090414d49" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-dba7b209-de3a-47c3-90cc-62c090414d49" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc82d14-2a78-4b16-91b9-4687d016c706]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:28 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.759s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Deleted volume successfully. Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d20e7249-1d72-4798-a3c5-b03ba6ee8137 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-63e116bb-1340-4999-9808-87d9f6fa0ebe-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:28 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 Jul 06 15:46:28 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:28 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9" returned: 0 in 0.780s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1657500648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3947f8d8-6416-43dd-b11c-0b514f95ca5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:14Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating volume 3947f8d8-6416-43dd-b11c-0b514f95ca5f {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:28 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3823735-fec6-47c5-a13d-8575d78b5083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569131a5-a98b-499e-8aaa-a7da890cd8b9', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:28 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f 1073741824 Jul 06 15:46:28 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ced7eb-2458-4e3f-9a0c-bce5c8599f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:28 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:28 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 (569131a5-a98b-499e-8aaa-a7da890cd8b9): created successfully Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ced7eb-2458-4e3f-9a0c-bce5c8599f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (52932f41-bb64-4857-9f73-6fb6049b5b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d" returned: 1 in 0.905s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3eda879-651e-436c-878b-50b25a030eee_31pac71d' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a0671a-c7d4-4fdd-a2c9-7fb76563515b]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e330832a-29be-4d1e-99ea-51b74dfadf7d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created volume successfully. Jul 06 15:46:28 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD Jul 06 15:46:28 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:29 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49" returned: 0 in 0.891s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:29 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49 Jul 06 15:46:29 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:29 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f 1073741824" returned: 0 in 0.868s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:29 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:29 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f Jul 06 15:46:29 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:29 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD Jul 06 15:46:29 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:29 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dba7b209-de3a-47c3-90cc-62c090414d49" returned: 0 in 0.678s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-dba7b209-de3a-47c3-90cc-62c090414d49" released by "delete_volume" :: held 1.619s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created reservations ['486672c5-8422-445a-b344-d22daace79f1', '28f4cbce-acc1-404f-8659-4aea26c81831', 'e020b1f8-6e2b-47e7-9d46-1f988e5fd799', 'b76ecd76-90d7-4f79-9886-e1afef250064'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:29 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:29 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:29 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f" returned: 0 in 0.667s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.303s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-163594881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfe0b73-7bc4-41fb-a435-3d6be699f4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating volume edfe0b73-7bc4-41fb-a435-3d6be699f4af {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:29 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:30 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD" returned: 1 in 0.773s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] b3eda879-651e-436c-878b-50b25a030eee was raw, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:46:30 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af 1073741824 Jul 06 15:46:30 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6be6f2-4199-4234-89c0-c6ccb1a56177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5381429-417d-4de3-a7ab-f24cf6f66d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:30 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:30 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:30 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f (3947f8d8-6416-43dd-b11c-0b514f95ca5f): created successfully Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5381429-417d-4de3-a7ab-f24cf6f66d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (d0059249-ffe7-474c-b6c7-2621ac66c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1106f86b-d756-4970-82f3-1efdbc1eec3b tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created volume successfully. Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-41868b40-3f1d-4c33-9b02-2e6fe072dcc5-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-41868b40-3f1d-4c33-9b02-2e6fe072dcc5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-quobyte-41868b40-3f1d-4c33-9b02-2e6fe072dcc5" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-41868b40-3f1d-4c33-9b02-2e6fe072dcc5" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7514943-c8c0-48d5-bf2e-fbd0061af2e7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:30 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.759s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Deleted volume successfully. Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0dfb8552-fd24-443a-a5b2-066c6a48c3a6 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-dba7b209-de3a-47c3-90cc-62c090414d49-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:30 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 Jul 06 15:46:30 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:30 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 0 in 0.925s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b3eda879-651e-436c-878b-50b25a030eee_16edl6mbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:46:30 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:30 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc 1G Jul 06 15:46:30 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:30 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af 1073741824" returned: 0 in 0.998s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:31 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af Jul 06 15:46:31 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:31 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5" returned: 0 in 0.786s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:31 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5 Jul 06 15:46:31 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:31 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc 1G" returned: 0 in 0.725s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:31 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f63d3b-b4d8-45bc-b85d-074ee2e2ba3b]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af" returned: 0 in 0.701s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.590s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074892315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98df7a9d-93ae-4947-b2f1-da49bd1bd109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating volume 98df7a9d-93ae-4947-b2f1-da49bd1bd109 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:31 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc300bc5-f44c-40a9-8427-441e0c5306e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:31 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 1073741824 Jul 06 15:46:31 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd5bb5e-b89d-4a86-b911-3410aacf3403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:31 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af (edfe0b73-7bc4-41fb-a435-3d6be699f4af): created successfully Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd5bb5e-b89d-4a86-b911-3410aacf3403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:31 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:31 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (b62313b4-f4b9-4cca-9cfa-44b7aafcf51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-afe6519a-ac9e-4b0c-88c1-6b3f1cc82176 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created volume successfully. Jul 06 15:46:32 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-41868b40-3f1d-4c33-9b02-2e6fe072dcc5" returned: 0 in 0.658s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-41868b40-3f1d-4c33-9b02-2e6fe072dcc5" released by "delete_volume" :: held 1.502s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created reservations ['b65dc396-3646-4a60-8c92-02f1d2789c7b', 'd03ef835-0adf-4c9d-87e2-2ea98e275a3b', '8f048317-e30b-4449-8339-6e037c81b60c', 'a7185468-0a64-44aa-b3ea-84f1a0cff6ce'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:32 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:32 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:32 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 0 in 0.779s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:32 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:32 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-bcba37a9-578f-49e3-9051-152b808d814f-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-bcba37a9-578f-49e3-9051-152b808d814f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:32 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 1073741824" returned: 0 in 1.013s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-quobyte-bcba37a9-578f-49e3-9051-152b808d814f" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-bcba37a9-578f-49e3-9051-152b808d814f" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[841340f6-5e39-4966-be1a-e5ced7d0ad4d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:32 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 Jul 06 15:46:32 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:32 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.724s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Deleted volume successfully. Jul 06 15:46:32 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2101e330-6412-4fa4-87e3-9c53cc188c17 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-41868b40-3f1d-4c33-9b02-2e6fe072dcc5-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:32 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f Jul 06 15:46:32 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:33 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 1 in 0.849s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Downloaded image b3eda879-651e-436c-878b-50b25a030eee ((None, [{'url': 'file:///opt/stack/data/glance/images/b3eda879-651e-436c-878b-50b25a030eee', 'metadata': {}}])) to volume 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Temporary image b3eda879-651e-436c-878b-50b25a030eee for user 61c3ff35def64de6b9effbdc62c027d3 is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Marking volume 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Copying metadata from image b3eda879-651e-436c-878b-50b25a030eee to 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Creating volume glance metadata for volume 7b18d05d-5db1-4d02-8d0c-397c8cfd39dc backed by image b3eda879-651e-436c-878b-50b25a030eee with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b3eda879-651e-436c-878b-50b25a030eee', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2b14549e6c5821a9aa177bb8941fdbdf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dcd6075-87ae-4f70-9c50-c0b8581b2445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc', 'volume_size': 1, 'image_id': 'b3eda879-651e-436c-878b-50b25a030eee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3eda879-651e-436c-878b-50b25a030eee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2b14549e6c5821a9aa177bb8941fdbdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b47c0786a969409a99ce4f75b5559174', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '340ad797c9dd58e3bd2808fc3a8df1672265fe44ff3b101651dcae0cd0eb045eebeb1c27c2a84c47c79cf6658c3c04e44ce722ddbc8f5d900270154f468bb8c0', 'id': 'b3eda879-651e-436c-878b-50b25a030eee', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3eda879-651e-436c-878b-50b25a030eee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68a77a9-9deb-4a13-b750-90a17846eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:33 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Volume volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc (7b18d05d-5db1-4d02-8d0c-397c8cfd39dc): created successfully Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68a77a9-9deb-4a13-b750-90a17846eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:33 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Flow 'volume_create_manager' (f7db4759-fbfd-492a-a11a-96c5c1d8c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109" returned: 0 in 0.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.096s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1505291792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1700f299-f0bb-46a5-9053-b3e261566509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de236b19c4b44aca8e4ea6a2f670a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:15Z,use_quota=True,user_id='2575d7f7fa9547ebb7dd7fc4467b2dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Creating volume 1700f299-f0bb-46a5-9053-b3e261566509 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:33 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e514d7ac-5877-4aa3-854f-ab76d0150815 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Created volume successfully. Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (701c83c3-8ec8-4966-944f-5d370e667df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a712bd6-2ed4-41d2-9ea4-98abe0f84ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:33 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 1073741824 Jul 06 15:46:33 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:33 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 (98df7a9d-93ae-4947-b2f1-da49bd1bd109): created successfully Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a712bd6-2ed4-41d2-9ea4-98abe0f84ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (3dd09e95-158d-4054-a11a-653bbee1e88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-630bfd43-ed07-4ad0-9972-a85b4ec750d8 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created volume successfully. Jul 06 15:46:33 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f" returned: 0 in 0.907s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:33 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f Jul 06 15:46:33 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Acquiring lock "cinder-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "cinder-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Acquiring lock "cinder-quobyte-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "cinder-quobyte-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" acquired by "delete_volume" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a7a30c-9b13-471f-899a-e736193b8d1e]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:34 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:34 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:34 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 1073741824" returned: 0 in 0.963s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:34 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-bcba37a9-578f-49e3-9051-152b808d814f" returned: 0 in 0.768s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-bcba37a9-578f-49e3-9051-152b808d814f" released by "delete_volume" :: held 1.734s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:34 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 Jul 06 15:46:34 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created reservations ['1452af85-e077-4f1f-b037-27d9b4e8edaf', 'ad744078-4e8b-4e5c-95d2-0eaabb0c53fc', '2141b835-3e2c-4697-a25a-3e5c8c89cb2d', '4ebacf5c-d683-4e92-8307-160ca42f4691'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:34 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:34 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-fd68f222-f13b-42d5-a487-685cb3b29013-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-fd68f222-f13b-42d5-a487-685cb3b29013-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-quobyte-fd68f222-f13b-42d5-a487-685cb3b29013" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-fd68f222-f13b-42d5-a487-685cb3b29013" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bc0c7c-56d4-4fe0-aa43-d21de1626f99]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:35 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 Jul 06 15:46:35 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:35 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 0 in 0.912s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:35 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:35 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:35 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509" returned: 0 in 0.832s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 12.265s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-quobyte-93a6952f-af7e-4e5d-beda-3f1fe9d40c27-423ec01b-7a22-4a35-89a1-74f4352b71c1" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8863bc63-4ec7-44f8-bc73-de66bbb68c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1700f299-f0bb-46a5-9053-b3e261566509', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed13f09-e974-4ebb-bf5c-30ad1b2a1012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-93a6952f-af7e-4e5d-beda-3f1fe9d40c27-423ec01b-7a22-4a35-89a1-74f4352b71c1" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Creating volume 423ec01b-7a22-4a35-89a1-74f4352b71c1 from snapshot 93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-quobyte-423ec01b-7a22-4a35-89a1-74f4352b71c1" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:35 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Volume volume-1700f299-f0bb-46a5-9053-b3e261566509 (1700f299-f0bb-46a5-9053-b3e261566509): created successfully Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed13f09-e974-4ebb-bf5c-30ad1b2a1012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Flow 'volume_create_manager' (c0c20d92-d1fe-431a-96e3-b9b0f69a598d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-423ec01b-7a22-4a35-89a1-74f4352b71c1" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] snapshot: 93a6952f-af7e-4e5d-beda-3f1fe9d40c27, volume: 423ec01b-7a22-4a35-89a1-74f4352b71c1, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ddd2cf49-4cf8-4267-97b0-71a3e63bb100 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created volume successfully. Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa053bcd-3d5a-463e-b9a7-09750c615779]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:35 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.836s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Deleted volume successfully. Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-92f76025-1254-4c04-88c9-3d804e3e4fb8 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-bcba37a9-578f-49e3-9051-152b808d814f-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:35 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 Jul 06 15:46:35 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:35 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013" returned: 0 in 0.896s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-1700f299-f0bb-46a5-9053-b3e261566509-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:35 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013 Jul 06 15:46:35 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-1700f299-f0bb-46a5-9053-b3e261566509-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-1700f299-f0bb-46a5-9053-b3e261566509" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-1700f299-f0bb-46a5-9053-b3e261566509" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfedfd5b-bc7e-4804-81d4-020c30d65842]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:36 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 1 in 0.970s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:36 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc Jul 06 15:46:36 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:36 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 Jul 06 15:46:36 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:36 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27" returned: 0 in 1.030s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-649d9f3f-b0dd-47a9-92d5-84886a447db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d8b42-05c7-4fad-9bcf-b2f10418f782]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:36 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:36 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:36 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd68f222-f13b-42d5-a487-685cb3b29013" returned: 0 in 0.763s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-fd68f222-f13b-42d5-a487-685cb3b29013" released by "delete_volume" :: held 1.708s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created reservations ['c660a4b8-6e08-4bb6-8794-379120141a6e', '808162ad-e3ed-46d8-b4f5-615a61c78b2a', '37650d12-bd1e-4def-b081-531ed4d4acf2', 'd3b3b69a-5942-4e3e-8f2d-421c4654cc14'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:36 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:36 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:36 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509" returned: 0 in 0.835s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:36 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" returned: 0 in 0.759s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "cinder-quobyte-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc" released by "delete_volume" :: held 2.713s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:36 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509 Jul 06 15:46:36 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Created reservations ['81011a93-11a6-4813-ac6a-b0a33cf1f3d1', '6aff8ec7-3e69-4465-afc8-372e0e8a07e1', '9fac033c-f1d5-4efb-a01f-1968d9d8eceb', 'd50d1925-814b-44cb-82fe-b6fdbcb02298'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:37 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:37 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-5541b97d-e507-4d35-bab4-8b47a0c2cdb0-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-5541b97d-e507-4d35-bab4-8b47a0c2cdb0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "cinder-quobyte-5541b97d-e507-4d35-bab4-8b47a0c2cdb0" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-5541b97d-e507-4d35-bab4-8b47a0c2cdb0" acquired by "delete_volume" :: waited 0.033s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[24610556-020c-4795-b462-183ccc79d229]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:37 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 0.943s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:37 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 Jul 06 15:46:37 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:37 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 Jul 06 15:46:37 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:37 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.954s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:37 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Deleted volume successfully. Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-24996f67-4f7b-4a0e-a9ef-6b93a324a77c tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-fd68f222-f13b-42d5-a487-685cb3b29013-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:37 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1700f299-f0bb-46a5-9053-b3e261566509" returned: 0 in 1.026s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-1700f299-f0bb-46a5-9053-b3e261566509" released by "delete_volume" :: held 1.911s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['60c9653d-d345-4b08-b326-db7ebd7925ae', '856a66f7-88e1-47f3-9668-b926303c9766', '211b8a5b-8d76-49e6-852f-1b1529052452', 'bd94184b-622e-49f0-81f5-953928e8e99d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:38 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:38 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:38 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.113s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Deleted volume successfully. Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-98df7a9d-93ae-4947-b2f1-da49bd1bd109-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-8def8035-2be6-4cac-aeb4-93ef1b07ab59 tempest-VolumeAndVolumeTypeFromImageTest-687774569 None] Lock "cinder-7b18d05d-5db1-4d02-8d0c-397c8cfd39dc-delete_volume" released by "delete_volume" :: held 4.197s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-98df7a9d-93ae-4947-b2f1-da49bd1bd109-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-98df7a9d-93ae-4947-b2f1-da49bd1bd109" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-98df7a9d-93ae-4947-b2f1-da49bd1bd109" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c36f05-ebdb-419f-a737-571ce1962d02]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:38 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:38 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 Jul 06 15:46:38 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0" returned: 0 in 1.259s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:38 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0 Jul 06 15:46:38 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:39 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.391s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:39 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleted volume successfully. Jul 06 15:46:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-6d9e260f-ddf0-48a6-b30a-16d56ddda99d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-1700f299-f0bb-46a5-9053-b3e261566509-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:40 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5541b97d-e507-4d35-bab4-8b47a0c2cdb0" returned: 0 in 1.974s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-quobyte-5541b97d-e507-4d35-bab4-8b47a0c2cdb0" released by "delete_volume" :: held 3.321s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:40 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Created reservations ['5254ee00-23d5-49b3-9041-81063b1656b9', '404e49a7-df64-4991-a99a-f646a578687b', 'c61b0517-8ee6-4577-8600-263f5ba9928e', '655acc4c-38db-4c70-99b4-82a529e2a309'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:40 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109" returned: 0 in 2.343s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:41 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109 Jul 06 15:46:41 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:41 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:41 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:41 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:42 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-98df7a9d-93ae-4947-b2f1-da49bd1bd109" returned: 0 in 1.370s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-98df7a9d-93ae-4947-b2f1-da49bd1bd109" released by "delete_volume" :: held 3.762s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['d385bd8a-92d9-4dd3-ac67-f9288e45d6a4', '7c09feec-3f6c-47cc-a887-021c8b86223a', 'b2848a06-ca9e-49a7-ab00-ae01c8b7952e', '0c08c214-a2f4-47da-a66e-2bc500a3d46c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:42 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.720s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Deleted volume successfully. Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:42 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:42 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-17f0f2a6-a357-4a67-a131-b4585b1b4241 tempest-CreateVolumesFromSourceVolumeTest-1749595237 None] Lock "cinder-5541b97d-e507-4d35-bab4-8b47a0c2cdb0-delete_volume" released by "delete_volume" :: held 5.604s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-edfe0b73-7bc4-41fb-a435-3d6be699f4af-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-edfe0b73-7bc4-41fb-a435-3d6be699f4af-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-edfe0b73-7bc4-41fb-a435-3d6be699f4af" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-edfe0b73-7bc4-41fb-a435-3d6be699f4af" acquired by "delete_volume" :: waited 0.063s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[694b41c0-b14f-419c-a982-c204a73f3e80]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:44 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af Jul 06 15:46:44 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:44 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.787s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:44 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleted volume successfully. Jul 06 15:46:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-62735c74-ac26-4407-a304-2a87f44155e4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-98df7a9d-93ae-4947-b2f1-da49bd1bd109-delete_volume" released by "delete_volume" :: held 6.238s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:44 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1" returned: 0 in 7.370s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c3677-0189-4a5e-b796-5a4d94a44bd2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:45 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:45 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:45 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af" returned: 0 in 1.606s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:45 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af Jul 06 15:46:45 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:46 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 1.313s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:46:46 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Converted 1024.00 MB image at 138.91 MB/s Jul 06 15:46:46 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 is being set with open permissions: ugo+rw Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:46 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 Jul 06 15:46:46 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:46 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-edfe0b73-7bc4-41fb-a435-3d6be699f4af" returned: 0 in 0.911s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-edfe0b73-7bc4-41fb-a435-3d6be699f4af" released by "delete_volume" :: held 2.629s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['b2931a85-9eab-43fa-b555-5bcb435bcf49', '9a4a660c-3ed2-46a3-86ec-ec080be7cabf', '17a84fee-fe7f-46de-9617-81ffa29ac02c', '1e3750eb-7465-41fe-9a42-fc7b41100c55'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:46 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:46 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:47 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1" returned: 0 in 0.815s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-3947f8d8-6416-43dd-b11c-0b514f95ca5f-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-423ec01b-7a22-4a35-89a1-74f4352b71c1" released by "_copy_volume_from_snapshot" :: held 11.618s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-93a6952f-af7e-4e5d-beda-3f1fe9d40c27-423ec01b-7a22-4a35-89a1-74f4352b71c1" released by "_create_volume_from_snapshot" :: held 11.686s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.725s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-3947f8d8-6416-43dd-b11c-0b514f95ca5f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3feadf0-4017-40ec-bcbc-5b4a7a0433e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423ec01b-7a22-4a35-89a1-74f4352b71c1', 'volume_size': 1, 'snapshot_id': '93a6952f-af7e-4e5d-beda-3f1fe9d40c27'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686d0945-9fae-40ce-b654-c3fb856fe3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Volume volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 (423ec01b-7a22-4a35-89a1-74f4352b71c1): created successfully Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686d0945-9fae-40ce-b654-c3fb856fe3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Flow 'volume_create_manager' (a0335c2d-3a6f-4f44-a92d-e73cea547504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-3947f8d8-6416-43dd-b11c-0b514f95ca5f" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-3947f8d8-6416-43dd-b11c-0b514f95ca5f" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5261e9e7-eb28-4e37-a61e-166a7d845aa7 tempest-VolumeDependencyTests-1221436542 None] Created volume successfully. Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdaeb36-68b7-483e-bd08-04b48f215ed2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:47 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.810s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleted volume successfully. Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae5b109f-cde9-46fa-9d2c-fce04a4a7af1 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-edfe0b73-7bc4-41fb-a435-3d6be699f4af-delete_volume" released by "delete_volume" :: held 3.877s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:47 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f Jul 06 15:46:47 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-93a6952f-af7e-4e5d-beda-3f1fe9d40c27-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-93a6952f-af7e-4e5d-beda-3f1fe9d40c27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-quobyte-649d9f3f-b0dd-47a9-92d5-84886a447db8" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-649d9f3f-b0dd-47a9-92d5-84886a447db8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-quobyte-93a6952f-af7e-4e5d-beda-3f1fe9d40c27" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-93a6952f-af7e-4e5d-beda-3f1fe9d40c27" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Deleting offline snapshot 93a6952f-af7e-4e5d-beda-3f1fe9d40c27 of volume 649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] snapshot_file for this snap is: volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7901bb0f-345e-4855-8330-091b49202083]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:47 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 Jul 06 15:46:47 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (f6a6520f-0273-4c8a-8d91-6b83489ce0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdbd163-2279-4a68-a20e-9fcc83260b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fdbd163-2279-4a68-a20e-9fcc83260b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370541189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448e52e3-ee74-4a84-942d-73c71486c56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:48Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec79eb8a-abdc-4a88-8178-7b1af4a02f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec79eb8a-abdc-4a88-8178-7b1af4a02f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1b62d2-f96b-4148-865f-23e4bf876ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1b62d2-f96b-4148-865f-23e4bf876ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448e52e3-ee74-4a84-942d-73c71486c56d', 'volume_name': 'volume-448e52e3-ee74-4a84-942d-73c71486c56d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2c4cea-d0ce-4c7a-9ec4-5c40bba3990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2c4cea-d0ce-4c7a-9ec4-5c40bba3990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdc860a-2d9a-481d-b12b-c30670102901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Volume 448e52e3-ee74-4a84-942d-73c71486c56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448e52e3-ee74-4a84-942d-73c71486c56d', 'volume_size': 1} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370541189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448e52e3-ee74-4a84-942d-73c71486c56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:48Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Creating volume 448e52e3-ee74-4a84-942d-73c71486c56d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:47 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:48 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d 1073741824 Jul 06 15:46:48 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (4a51fd32-5b39-455c-af19-2885df489eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfb5986-267c-4c19-aba9-117313cdd82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfb5986-267c-4c19-aba9-117313cdd82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1539119487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e9a630-5f4f-4fc4-8711-746bab313e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:48Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b73847-e7e1-4bc7-8672-0e74f6ae37a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b73847-e7e1-4bc7-8672-0e74f6ae37a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f118a0-6cb0-4f70-b4c5-868541960ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f118a0-6cb0-4f70-b4c5-868541960ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e9a630-5f4f-4fc4-8711-746bab313e68', 'volume_name': 'volume-c3e9a630-5f4f-4fc4-8711-746bab313e68', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a122cd-8a53-4165-8f49-ad2fdb9b235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a122cd-8a53-4165-8f49-ad2fdb9b235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d12c5a-1fb8-4b4f-89f3-7994b8d9da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:48 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Volume c3e9a630-5f4f-4fc4-8711-746bab313e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e9a630-5f4f-4fc4-8711-746bab313e68', 'volume_size': 1} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:48 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f" returned: 0 in 1.420s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:48 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f Jul 06 15:46:48 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:48 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27" returned: 0 in 1.248s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-649d9f3f-b0dd-47a9-92d5-84886a447db8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db71dc-ed34-4493-a380-01733bfa9722]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:48 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (fe74bc69-c884-4ac5-814a-d2ad1d389dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fd5219-bfca-4d6a-b5bd-8a535e36c0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3fd5219-bfca-4d6a-b5bd-8a535e36c0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-491177631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e072da8-9053-4c85-b880-7274adad4d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:49Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07784d5f-38bf-4fca-9227-00bf6f7be538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07784d5f-38bf-4fca-9227-00bf6f7be538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c126bcd0-3acd-496c-ac5a-6f98f6d4a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c126bcd0-3acd-496c-ac5a-6f98f6d4a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e072da8-9053-4c85-b880-7274adad4d8e', 'volume_name': 'volume-8e072da8-9053-4c85-b880-7274adad4d8e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827e8a3d-ee73-46d0-8ba3-238db28cfefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:49 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827e8a3d-ee73-46d0-8ba3-238db28cfefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b01e35-e6e2-4c08-a8fb-5f5e3f0479dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Volume 8e072da8-9053-4c85-b880-7274adad4d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e072da8-9053-4c85-b880-7274adad4d8e', 'volume_size': 1} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:49 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d 1073741824" returned: 0 in 1.300s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:49 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d Jul 06 15:46:49 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:49 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3947f8d8-6416-43dd-b11c-0b514f95ca5f" returned: 0 in 0.969s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (21d8c068-0ad9-41df-a58f-a1dd30f1c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1c478d-fb5e-459d-8ed2-4c4f5078c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-3947f8d8-6416-43dd-b11c-0b514f95ca5f" released by "delete_volume" :: held 2.591s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1c478d-fb5e-459d-8ed2-4c4f5078c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166941959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18402e2c-5e75-48e5-960f-81d03b8ec98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:50Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fbc66f-2c76-4821-ab85-59e41a93e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fbc66f-2c76-4821-ab85-59e41a93e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66df67f7-554d-4189-b83d-51387fc51731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66df67f7-554d-4189-b83d-51387fc51731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18402e2c-5e75-48e5-960f-81d03b8ec98b', 'volume_name': 'volume-18402e2c-5e75-48e5-960f-81d03b8ec98b', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bb0b3e-27fb-458d-8ae2-17a4e1973092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bb0b3e-27fb-458d-8ae2-17a4e1973092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d9aa7b-c88e-4d8a-b07d-83cd70f8a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Volume 18402e2c-5e75-48e5-960f-81d03b8ec98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18402e2c-5e75-48e5-960f-81d03b8ec98b', 'volume_size': 1} Jul 06 15:46:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['9e157715-bf9f-4dae-9c2d-61a8df31ce4c', '1207048c-48e6-49ee-8e6a-9fe15a24a466', '616c0d77-f040-4893-ba25-40ee6c6e2f4f', '7a108873-9a71-44ed-b298-d619c3fcde04'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:50 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 1.361s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:50 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:50 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:50 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 Jul 06 15:46:50 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (e97d81cf-b3fa-4b01-af64-4299a2d41f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54e0709-968e-4a8e-b5f2-9d4fe2c3ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54e0709-968e-4a8e-b5f2-9d4fe2c3ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-235252512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d159c2-ff5a-4078-8f62-729496539fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:50Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34925b87-9ed5-4eb0-82a5-ca49e8063386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34925b87-9ed5-4eb0-82a5-ca49e8063386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6973a24-1498-438c-9f25-99aa97958425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6973a24-1498-438c-9f25-99aa97958425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d159c2-ff5a-4078-8f62-729496539fb0', 'volume_name': 'volume-f5d159c2-ff5a-4078-8f62-729496539fb0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373b3944-077a-4107-9018-666e8f58435d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373b3944-077a-4107-9018-666e8f58435d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b92537-9c47-4e32-8351-ce991c1c8314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Volume f5d159c2-ff5a-4078-8f62-729496539fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d159c2-ff5a-4078-8f62-729496539fb0', 'volume_size': 1} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-569131a5-a98b-499e-8aaa-a7da890cd8b9-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-569131a5-a98b-499e-8aaa-a7da890cd8b9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-569131a5-a98b-499e-8aaa-a7da890cd8b9" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-569131a5-a98b-499e-8aaa-a7da890cd8b9" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[83768e38-a676-40bc-9e55-bee80329521a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:50 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d" returned: 0 in 1.407s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] <== create_volume: return (2800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.802s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1539119487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e9a630-5f4f-4fc4-8711-746bab313e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:48Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Creating volume c3e9a630-5f4f-4fc4-8711-746bab313e68 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:50 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:50 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 1073741824 Jul 06 15:46:50 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bdc860a-2d9a-481d-b12b-c30670102901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448e52e3-ee74-4a84-942d-73c71486c56d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d5c2e2-bdca-40f2-90a3-aa837cd9d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:50 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Volume volume-448e52e3-ee74-4a84-942d-73c71486c56d (448e52e3-ee74-4a84-942d-73c71486c56d): created successfully Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d5c2e2-bdca-40f2-90a3-aa837cd9d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:50 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 Jul 06 15:46:50 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:50 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (f6a6520f-0273-4c8a-8d91-6b83489ce0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:50 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e7e47bba-5d28-4091-9b97-d180f915a564 tempest-CreateVolumesFromImageTest-2064699655 None] Created volume successfully. Jul 06 15:46:51 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.224s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleted volume successfully. Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93f89156-ae9c-439a-ab1f-92fcd532e3c4 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-3947f8d8-6416-43dd-b11c-0b514f95ca5f-delete_volume" released by "delete_volume" :: held 4.412s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:51 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27" returned: 0 in 1.307s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:51 devstack sudo[104623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27 Jul 06 15:46:51 devstack sudo[104623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:51 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9" returned: 0 in 1.113s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:51 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:51 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9 Jul 06 15:46:51 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 1073741824" returned: 0 in 1.076s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:52 devstack sudo[104632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 Jul 06 15:46:52 devstack sudo[104632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Flow 'volume_create_manager' (3fa3cdb1-19df-4932-91d6-16549f948f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee99a6-9cfb-42c0-a3b8-124984634b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee99a6-9cfb-42c0-a3b8-124984634b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3c1c76-47bd-4f28-ab4d-fca516f041a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7d3395dbb945a797121d5fb051bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:52Z,use_quota=True,user_id='92b9d4a35e0b4409829c9a3fec090eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f53f11-9fb4-4e02-96fb-1fdf319f712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f53f11-9fb4-4e02-96fb-1fdf319f712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a02b05-dda0-476f-91f9-a8cdf2e76590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.image.glance [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Creating Keystone auth plugin from conf {{(pid=86191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 15:46:52 devstack sudo[104623]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8.93a6952f-af7e-4e5d-beda-3f1fe9d40c27" returned: 0 in 0.790s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-93a6952f-af7e-4e5d-beda-3f1fe9d40c27" released by "_delete_snapshot" :: held 4.876s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-649d9f3f-b0dd-47a9-92d5-84886a447db8" released by "delete_snapshot" :: held 4.915s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Created reservations ['601e3b0b-3e15-498a-9632-2c70869338a4', 'fa2a6622-1a28-4c27-83b7-7ab513d19baa', 'dc176de9-d319-4f89-9672-d3a0b6f553c6', 'baf2d0e0-6be8-4972-9019-19e269e76ed6'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a02b05-dda0-476f-91f9-a8cdf2e76590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa3c1c76-47bd-4f28-ab4d-fca516f041a2', 'volume_name': 'volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2', 'volume_size': 1, 'image_id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c789f06-ccea-432e-92d4-09cfa0421b2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef5e181cbd4f5f634e22176c8b311be2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d7d3395dbb945a797121d5fb051bb12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85d764ae1723bafffe63ac7f21cfdfc6c04ae56015ebe5db8922a674d1bf60d3eea20d65fdc9d209e080c6a663905d77565e4977c0b3a8ba5abdefbf7fea453f', 'id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c789f06-ccea-432e-92d4-09cfa0421b2e/file', 'properties': {}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc191fc-84ba-4313-99fb-14d11c732d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc191fc-84ba-4313-99fb-14d11c732d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9a520e-c560-4e55-88ba-eddad4e7b0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Volume fa3c1c76-47bd-4f28-ab4d-fca516f041a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2', 'volume_size': 1, 'image_id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c789f06-ccea-432e-92d4-09cfa0421b2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef5e181cbd4f5f634e22176c8b311be2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d7d3395dbb945a797121d5fb051bb12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85d764ae1723bafffe63ac7f21cfdfc6c04ae56015ebe5db8922a674d1bf60d3eea20d65fdc9d209e080c6a663905d77565e4977c0b3a8ba5abdefbf7fea453f', 'id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c789f06-ccea-432e-92d4-09cfa0421b2e/file', 'properties': {}}, 'image_service': } Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Trying to clone fa3c1c76-47bd-4f28-ab4d-fca516f041a2 from image 8c789f06-ccea-432e-92d4-09cfa0421b2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c789f06-ccea-432e-92d4-09cfa0421b2e', 'metadata': {}}]). {{(pid=86191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 15:46:52 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-569131a5-a98b-499e-8aaa-a7da890cd8b9" returned: 0 in 0.799s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Delete snapshot completed successfully. Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1923966b-a7be-4a16-a74e-4ebe351ab03b tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-93a6952f-af7e-4e5d-beda-3f1fe9d40c27-delete_snapshot" released by "delete_snapshot" :: held 5.155s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-569131a5-a98b-499e-8aaa-a7da890cd8b9" released by "delete_volume" :: held 1.982s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 15:46:52 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Image download 0.00 MB at 0.00 MB/s Jul 06 15:46:52 devstack sudo[104632]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68" returned: 0 in 0.810s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.645s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-491177631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e072da8-9053-4c85-b880-7274adad4d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:49Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Creating volume 8e072da8-9053-4c85-b880-7274adad4d8e {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:52 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['2ea817ce-e93f-4e6f-a2f9-98118816e1b5', '7a989fcf-fd0e-410f-812e-059f06862847', 'b5cbd773-ee0c-4dc6-b6ad-3d399efa81c2', 'e7af69b8-9941-46f0-aa1b-e9f6097ca18a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:52 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e 1073741824 Jul 06 15:46:52 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d12c5a-1fb8-4b4f-89f3-7994b8d9da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e9a630-5f4f-4fc4-8711-746bab313e68', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e34ee93-44f2-4fd9-bfe8-32628971343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f08e437-b31c-4c22-9b5c-17fb7f1de5f9]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Volume volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 (c3e9a630-5f4f-4fc4-8711-746bab313e68): created successfully Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e34ee93-44f2-4fd9-bfe8-32628971343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (4a51fd32-5b39-455c-af19-2885df489eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c3dc0c83-ab14-4879-8051-2f1a656a9c05 tempest-CreateVolumesFromImageTest-2064699655 None] Created volume successfully. Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-649d9f3f-b0dd-47a9-92d5-84886a447db8-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-649d9f3f-b0dd-47a9-92d5-84886a447db8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:53 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:53 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:53 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD Jul 06 15:46:53 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-quobyte-649d9f3f-b0dd-47a9-92d5-84886a447db8" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-649d9f3f-b0dd-47a9-92d5-84886a447db8" acquired by "delete_volume" :: waited 0.032s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf12dc-072d-4876-9415-8e2365004350]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:53 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:53 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:53 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e 1073741824" returned: 0 in 0.863s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:53 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:53 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e Jul 06 15:46:53 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.741s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:53 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:53 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleted volume successfully. Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-36cd2347-7422-4d1a-9059-a81479bab71d tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-569131a5-a98b-499e-8aaa-a7da890cd8b9-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:53 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD Jul 06 15:46:53 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-a328fdf4-8f4e-434d-99fe-f420f63ca586-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-a328fdf4-8f4e-434d-99fe-f420f63ca586-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:53 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-d0084ec9-d53e-4527-b01e-ca11f328c5d1" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-d0084ec9-d53e-4527-b01e-ca11f328c5d1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-a328fdf4-8f4e-434d-99fe-f420f63ca586" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-a328fdf4-8f4e-434d-99fe-f420f63ca586" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleting offline snapshot a328fdf4-8f4e-434d-99fe-f420f63ca586 of volume d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:46:54 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] snapshot_file for this snap is: volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 0.917s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83315df-543c-4553-9cd9-27962c36649f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:54 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8 Jul 06 15:46:54 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:54 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 Jul 06 15:46:54 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:54 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e" returned: 0 in 0.796s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.529s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1166941959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18402e2c-5e75-48e5-960f-81d03b8ec98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:50Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Creating volume 18402e2c-5e75-48e5-960f-81d03b8ec98b {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:54 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b01e35-e6e2-4c08-a8fb-5f5e3f0479dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e072da8-9053-4c85-b880-7274adad4d8e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:54 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b 1073741824 Jul 06 15:46:54 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2b9ebd-8483-4867-81bf-9bcb902299fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:54 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Volume volume-8e072da8-9053-4c85-b880-7274adad4d8e (8e072da8-9053-4c85-b880-7274adad4d8e): created successfully Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2b9ebd-8483-4867-81bf-9bcb902299fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (fe74bc69-c884-4ac5-814a-d2ad1d389dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-14889f9a-6802-459d-86ff-4bd0d9cceea4 tempest-CreateVolumesFromImageTest-2064699655 None] Created volume successfully. Jul 06 15:46:54 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD" returned: 1 in 0.969s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Temporary image 8c789f06-ccea-432e-92d4-09cfa0421b2e is fetched for user 92b9d4a35e0b4409829c9a3fec090eda. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e97c4-5400-4d65-811d-a9941d9c8126]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:54 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-649d9f3f-b0dd-47a9-92d5-84886a447db8" returned: 0 in 0.814s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-649d9f3f-b0dd-47a9-92d5-84886a447db8" released by "delete_volume" :: held 1.829s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:54 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD Jul 06 15:46:54 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Created reservations ['472c7a30-cd8f-43b7-a28a-c9e66ee27407', '8f52ad07-a4b6-425d-a600-6f6a7acf0c87', '28ef583f-f4c2-4dd8-8292-fa36b213ed54', '3d7faff3-78e7-41a4-a026-9f8fd1b2c5da'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:55 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586" returned: 0 in 1.064s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:46:55 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:55 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c053b6-74c1-4c27-99a3-8db6a27004cd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-423ec01b-7a22-4a35-89a1-74f4352b71c1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-423ec01b-7a22-4a35-89a1-74f4352b71c1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "cinder-quobyte-423ec01b-7a22-4a35-89a1-74f4352b71c1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-423ec01b-7a22-4a35-89a1-74f4352b71c1" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff1be2-6298-4fde-8f30-55a4332689fd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:55 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 Jul 06 15:46:55 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:55 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 Jul 06 15:46:55 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:55 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:55 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD Jul 06 15:46:55 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:55 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b 1073741824" returned: 0 in 1.248s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:55 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b Jul 06 15:46:55 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:56 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.905s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Deleted volume successfully. Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0ce8aed5-ad20-4770-b294-eafb37f67c60 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-649d9f3f-b0dd-47a9-92d5-84886a447db8-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:56 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1" returned: 0 in 1.104s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:56 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 Jul 06 15:46:56 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:56 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:56 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1" returned: 0 in 1.050s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:56 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1 Jul 06 15:46:56 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:56 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b" returned: 0 in 0.864s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] <== create_volume: return (2192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.176s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-235252512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d159c2-ff5a-4078-8f62-729496539fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac903fe79f054cdb954c29469a657c08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:50Z,use_quota=True,user_id='01d5f75db638493abf6aa5046191cc52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Creating volume f5d159c2-ff5a-4078-8f62-729496539fb0 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:56 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:56 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 1073741824 Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d9aa7b-c88e-4d8a-b07d-83cd70f8a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18402e2c-5e75-48e5-960f-81d03b8ec98b', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:56 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbddd14b-1ef3-4765-9e2a-be8539531256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:56 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Volume volume-18402e2c-5e75-48e5-960f-81d03b8ec98b (18402e2c-5e75-48e5-960f-81d03b8ec98b): created successfully Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbddd14b-1ef3-4765-9e2a-be8539531256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:56 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (21d8c068-0ad9-41df-a58f-a1dd30f1c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-4286db4a-cf6a-48bb-996a-06f9b2eb08a9 tempest-CreateVolumesFromImageTest-2064699655 None] Created volume successfully. Jul 06 15:46:57 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586" returned: 0 in 0.811s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:57 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-423ec01b-7a22-4a35-89a1-74f4352b71c1" returned: 0 in 0.691s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:57 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586 Jul 06 15:46:57 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-quobyte-423ec01b-7a22-4a35-89a1-74f4352b71c1" released by "delete_volume" :: held 1.809s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Created reservations ['3382238b-a696-4a8c-8708-615084478d41', 'ce1273c8-a562-4813-99b7-50990ca03045', 'baa0adbd-4bce-4c56-8c83-098ee550655e', 'da62a795-37b3-465e-b312-6cfb6dda139d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:57 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:46:57 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:57 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 1073741824" returned: 0 in 0.888s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:57 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 Jul 06 15:46:57 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:57 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1.a328fdf4-8f4e-434d-99fe-f420f63ca586" returned: 0 in 0.793s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-a328fdf4-8f4e-434d-99fe-f420f63ca586" released by "_delete_snapshot" :: held 3.920s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-d0084ec9-d53e-4527-b01e-ca11f328c5d1" released by "delete_snapshot" :: held 3.958s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:58 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:46:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Deleted volume successfully. Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['7be83051-2864-4fa9-b7ef-57e145cb612c', 'de582242-355a-477c-8821-6486efa723ac', '02e638ef-cc5b-4d2c-be70-2c506fd1cd99', 'ac069625-64ab-4fc8-b560-36a00c0d743a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7b4d5fa7-6d61-435d-bd00-602c05ce0465 tempest-VolumeDependencyTests-1221436542 None] Lock "cinder-423ec01b-7a22-4a35-89a1-74f4352b71c1-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Delete snapshot completed successfully. Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9df54cdd-4485-4154-bffb-59d0db744ceb tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-a328fdf4-8f4e-434d-99fe-f420f63ca586-delete_snapshot" released by "delete_snapshot" :: held 4.152s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-d0084ec9-d53e-4527-b01e-ca11f328c5d1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-d0084ec9-d53e-4527-b01e-ca11f328c5d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:58 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0" returned: 0 in 0.708s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "cinder-quobyte-d0084ec9-d53e-4527-b01e-ca11f328c5d1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.911s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3c1c76-47bd-4f28-ab4d-fca516f041a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7d3395dbb945a797121d5fb051bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:46:52Z,use_quota=True,user_id='92b9d4a35e0b4409829c9a3fec090eda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Creating volume fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:46:58 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b92537-9c47-4e32-8351-ce991c1c8314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d159c2-ff5a-4078-8f62-729496539fb0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:58 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 1073741824 Jul 06 15:46:58 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1114568f-5b26-4f52-93e8-92bfaf9a9931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-d0084ec9-d53e-4527-b01e-ca11f328c5d1" acquired by "delete_volume" :: waited 0.072s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:58 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Volume volume-f5d159c2-ff5a-4078-8f62-729496539fb0 (f5d159c2-ff5a-4078-8f62-729496539fb0): created successfully Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1114568f-5b26-4f52-93e8-92bfaf9a9931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Flow 'volume_create_manager' (e97d81cf-b3fa-4b01-af64-4299a2d41f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[989fa55a-552f-4548-98f5-8dcbea6a7dbe]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d360a543-8f7b-4237-846b-a73a17fc0c56 tempest-CreateVolumesFromImageTest-2064699655 None] Created volume successfully. Jul 06 15:46:58 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 Jul 06 15:46:58 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:59 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 1073741824" returned: 0 in 0.931s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:59 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:46:59 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:59 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1" returned: 0 in 0.958s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:59 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1 Jul 06 15:46:59 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-f5d159c2-ff5a-4078-8f62-729496539fb0-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-f5d159c2-ff5a-4078-8f62-729496539fb0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-quobyte-f5d159c2-ff5a-4078-8f62-729496539fb0" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-f5d159c2-ff5a-4078-8f62-729496539fb0" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231620d-5299-418a-9ac8-9cb686be838b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:46:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:46:59 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 Jul 06 15:46:59 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:00 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 0 in 0.761s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Attempting download of 8c789f06-ccea-432e-92d4-09cfa0421b2e ((None, [{'url': 'file:///opt/stack/data/glance/images/8c789f06-ccea-432e-92d4-09cfa0421b2e', 'metadata': {}}])) to volume fa3c1c76-47bd-4f28-ab4d-fca516f041a2. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 15:47:00 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d0084ec9-d53e-4527-b01e-ca11f328c5d1" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-quobyte-d0084ec9-d53e-4527-b01e-ca11f328c5d1" released by "delete_volume" :: held 1.773s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d25526-e621-4144-8706-c5a7678fef2b]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Created reservations ['2ac33787-0425-49a8-82d5-a529ae7bbf14', '93b213ec-0dcb-4579-b277-4a0f939e9597', '23aa0cee-5aa2-4622-861d-97991440f016', '185abe87-46a9-4f9b-9401-078c52938acb'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:00 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg Jul 06 15:47:00 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:00 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:00 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:00 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0" returned: 0 in 1.032s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:00 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0 Jul 06 15:47:00 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:01 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg" returned: 0 in 0.887s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:01 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg Jul 06 15:47:01 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:01 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.935s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Deleted volume successfully. Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=145,cinder:UPDATE=204,cinder:DELETE=18,cinder:INSERT=52 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b300cd07-fcdf-4485-b8f3-c19f76754bb0 tempest-CreateVolumesFromSnapshotTest-1840472820 None] Lock "cinder-d0084ec9-d53e-4527-b01e-ca11f328c5d1-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=144,cinder:UPDATE=192,cinder:INSERT=49,cinder:DELETE=19 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:01 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Flow 'volume_create_manager' (9106eea2-2b1c-40c8-8b5b-285e1296a866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a76b931-fbf4-4e6d-bebe-2c083c9c7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-f5d159c2-ff5a-4078-8f62-729496539fb0" returned: 0 in 0.931s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-f5d159c2-ff5a-4078-8f62-729496539fb0" released by "delete_volume" :: held 2.044s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a76b931-fbf4-4e6d-bebe-2c083c9c7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104060c9-65b7-4301-acf5-7a022393e7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a24725e5b3524915b6c61eac308a8c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:02Z,use_quota=True,user_id='946f5e0f55574278acd575231b46ed66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82029cc-2b89-4318-ba31-a770d799d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82029cc-2b89-4318-ba31-a770d799d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c903a65b-3c25-4f3d-b9e9-816a38129d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c903a65b-3c25-4f3d-b9e9-816a38129d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104060c9-65b7-4301-acf5-7a022393e7d3', 'volume_name': 'volume-104060c9-65b7-4301-acf5-7a022393e7d3', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed690694-079b-4560-b718-c6590c28ebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed690694-079b-4560-b718-c6590c28ebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739d016c-0f64-4692-a2b6-c590e1f8a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:01 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Volume 104060c9-65b7-4301-acf5-7a022393e7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104060c9-65b7-4301-acf5-7a022393e7d3', 'volume_size': 1} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104060c9-65b7-4301-acf5-7a022393e7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a24725e5b3524915b6c61eac308a8c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:02Z,use_quota=True,user_id='946f5e0f55574278acd575231b46ed66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Creating volume 104060c9-65b7-4301-acf5-7a022393e7d3 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:01 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:01 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 1073741824 Jul 06 15:47:01 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:01 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Created reservations ['be865a34-04a2-4b7d-9620-589dd6473581', '6ac8b1cd-ace0-4628-bc5f-1d413e2e8a77', 'd4cee4a4-6fb8-43a1-84f8-be4441d14bd8', 'c15c0886-b043-43f4-9d2e-99f423f19c4d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:02 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:02 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:02 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg" returned: 1 in 0.980s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c789f06-ccea-432e-92d4-09cfa0421b2e_dntkfavg' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e4cdb9-3939-4d76-8602-b6a6c308ecc5]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:02 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD Jul 06 15:47:02 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:02 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.839s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Deleted volume successfully. Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2460e9a2-d72e-4cac-a20d-c16747539085 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-f5d159c2-ff5a-4078-8f62-729496539fb0-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:02 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD" returned: 0 in 0.878s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-18402e2c-5e75-48e5-960f-81d03b8ec98b-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:03 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 1073741824" returned: 0 in 1.213s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-18402e2c-5e75-48e5-960f-81d03b8ec98b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:03 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD Jul 06 15:47:03 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-quobyte-18402e2c-5e75-48e5-960f-81d03b8ec98b" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-18402e2c-5e75-48e5-960f-81d03b8ec98b" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:03 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 Jul 06 15:47:03 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be3c516-0287-46be-be1c-02a356137868]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:03 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b Jul 06 15:47:03 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:03 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD" returned: 1 in 0.893s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] 8c789f06-ccea-432e-92d4-09cfa0421b2e was raw, converting to raw {{(pid=86191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 15:47:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:03 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:47:03 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:04 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3" returned: 0 in 0.907s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (739d016c-0f64-4692-a2b6-c590e1f8a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104060c9-65b7-4301-acf5-7a022393e7d3', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff5c40-2fc7-4602-82dc-86cacf21f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Volume volume-104060c9-65b7-4301-acf5-7a022393e7d3 (104060c9-65b7-4301-acf5-7a022393e7d3): created successfully Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dff5c40-2fc7-4602-82dc-86cacf21f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Flow 'volume_create_manager' (9106eea2-2b1c-40c8-8b5b-285e1296a866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cbbe989a-8ad3-4aea-9de5-1533c618aa83 tempest-CinderUnicodeTest-79582333 None] Created volume successfully. Jul 06 15:47:04 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b" returned: 0 in 0.989s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:04 devstack sudo[104799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b Jul 06 15:47:04 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:04 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 0 in 0.937s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c789f06-ccea-432e-92d4-09cfa0421b2e_p5t_xmqddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:47:04 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:04 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 1G Jul 06 15:47:04 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:04 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-18402e2c-5e75-48e5-960f-81d03b8ec98b" returned: 0 in 0.711s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-18402e2c-5e75-48e5-960f-81d03b8ec98b" released by "delete_volume" :: held 1.756s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:04 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Created reservations ['b9bc04cb-3672-4ac6-b716-dc6482942b62', 'edf0da66-6ec5-4c51-adad-ff5f8e36ba62', '783263af-3532-4f25-904f-f55565f2ae8e', 'a505235d-a20c-49c3-8a29-c90f411b9d99'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:05 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:05 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-8e072da8-9053-4c85-b880-7274adad4d8e-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-8e072da8-9053-4c85-b880-7274adad4d8e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-quobyte-8e072da8-9053-4c85-b880-7274adad4d8e" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-8e072da8-9053-4c85-b880-7274adad4d8e" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d7be1-61ec-4dd1-a6f8-cc809f6ac5f8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:05 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e Jul 06 15:47:05 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (e3fd74d1-f1f3-4aea-b55a-f9cc3be2d7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115ecb9e-7461-4141-8e5b-993316c5205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115ecb9e-7461-4141-8e5b-993316c5205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252526939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6745fded-7141-4678-83da-949d27893dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:06Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750cb908-77ff-44d8-b92a-ed6a5290eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750cb908-77ff-44d8-b92a-ed6a5290eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838894c0-dfb7-4707-8000-d3981b291db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838894c0-dfb7-4707-8000-d3981b291db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6745fded-7141-4678-83da-949d27893dca', 'volume_name': 'volume-6745fded-7141-4678-83da-949d27893dca', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85602cd8-a1cf-40cf-8de5-64a8d629bef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85602cd8-a1cf-40cf-8de5-64a8d629bef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d604f3-ab12-4b39-b9eb-d5532039276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Volume 6745fded-7141-4678-83da-949d27893dca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6745fded-7141-4678-83da-949d27893dca', 'volume_size': 1} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1252526939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6745fded-7141-4678-83da-949d27893dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:06Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Creating volume 6745fded-7141-4678-83da-949d27893dca {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:05 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 1G" returned: 0 in 1.091s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:05 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca 1073741824 Jul 06 15:47:05 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:05 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Flow 'volume_create_manager' (fe3fad94-ec68-41cb-b360-2f802d843fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09ffba0-a2fe-41f1-aace-65087a5a82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ec508-a565-4074-876c-d3ac669957cf]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.892s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09ffba0-a2fe-41f1-aace-65087a5a82c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214250167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5a5d79-ec4d-40d4-8247-810180201647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a24725e5b3524915b6c61eac308a8c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:06Z,use_quota=True,user_id='946f5e0f55574278acd575231b46ed66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e418550-9844-41f4-ba01-480fee3cf8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e418550-9844-41f4-ba01-480fee3cf8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ca0137-fa4f-4cfb-8b53-4fd7af2bb403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:05 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ca0137-fa4f-4cfb-8b53-4fd7af2bb403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5a5d79-ec4d-40d4-8247-810180201647', 'volume_name': 'volume-4e5a5d79-ec4d-40d4-8247-810180201647', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43e1e17-64f5-4a1f-a5a5-98180d992ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43e1e17-64f5-4a1f-a5a5-98180d992ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2165336f-f977-40c5-8384-4547f5fbeab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:06 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Volume 4e5a5d79-ec4d-40d4-8247-810180201647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5a5d79-ec4d-40d4-8247-810180201647', 'volume_size': 1} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Deleted volume successfully. Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-da6393cc-467c-4f74-84a1-732466b6798e tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-18402e2c-5e75-48e5-960f-81d03b8ec98b-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:06 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:47:06 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:06 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e" returned: 0 in 0.854s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:06 devstack sudo[104823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e Jul 06 15:47:06 devstack sudo[104823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:06 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 0 in 0.867s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:06 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca 1073741824" returned: 0 in 1.006s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:06 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:06 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:06 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca Jul 06 15:47:06 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:06 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:47:06 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:07 devstack sudo[104823]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8e072da8-9053-4c85-b880-7274adad4d8e" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-8e072da8-9053-4c85-b880-7274adad4d8e" released by "delete_volume" :: held 1.626s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Created reservations ['cd88e850-e55c-43dc-9b56-85730362a3f6', '82ac70b4-ece1-4c65-a9e9-14004026e296', 'f72c69d6-b5e9-4f92-9eda-04b1e3be836c', 'bd5f59dc-e2c5-40a4-9b84-ca8e7ad7dbe6'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:07 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:07 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:07 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.870s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-c3e9a630-5f4f-4fc4-8711-746bab313e68-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-c3e9a630-5f4f-4fc4-8711-746bab313e68-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:07 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 1 in 1.036s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Downloaded image 8c789f06-ccea-432e-92d4-09cfa0421b2e ((None, [{'url': 'file:///opt/stack/data/glance/images/8c789f06-ccea-432e-92d4-09cfa0421b2e', 'metadata': {}}])) to volume fa3c1c76-47bd-4f28-ab4d-fca516f041a2 successfully. {{(pid=86191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Temporary image 8c789f06-ccea-432e-92d4-09cfa0421b2e for user 92b9d4a35e0b4409829c9a3fec090eda is deleted. {{(pid=86191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.volume_utils [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Marking volume fa3c1c76-47bd-4f28-ab4d-fca516f041a2 as bootable. {{(pid=86191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-quobyte-c3e9a630-5f4f-4fc4-8711-746bab313e68" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Copying metadata from image 8c789f06-ccea-432e-92d4-09cfa0421b2e to fa3c1c76-47bd-4f28-ab4d-fca516f041a2. {{(pid=86191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Creating volume glance metadata for volume fa3c1c76-47bd-4f28-ab4d-fca516f041a2 backed by image 8c789f06-ccea-432e-92d4-09cfa0421b2e with: {'image_id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ef5e181cbd4f5f634e22176c8b311be2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-c3e9a630-5f4f-4fc4-8711-746bab313e68" acquired by "delete_volume" :: waited 0.027s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:07 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca" returned: 0 in 0.988s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbef484-47d5-4b52-babd-74ae536bf363]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.904s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214250167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5a5d79-ec4d-40d4-8247-810180201647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a24725e5b3524915b6c61eac308a8c89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:06Z,use_quota=True,user_id='946f5e0f55574278acd575231b46ed66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Creating volume 4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:07 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:07 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 1073741824 Jul 06 15:47:07 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d604f3-ab12-4b39-b9eb-d5532039276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6745fded-7141-4678-83da-949d27893dca', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56a3137-413f-4097-bc80-8f3c58d0e1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Volume volume-6745fded-7141-4678-83da-949d27893dca (6745fded-7141-4678-83da-949d27893dca): created successfully Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56a3137-413f-4097-bc80-8f3c58d0e1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (e3fd74d1-f1f3-4aea-b55a-f9cc3be2d7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e3eb5881-93c3-4a71-b8a9-8bfd1afd9c3c tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f9a520e-c560-4e55-88ba-eddad4e7b0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2', 'volume_size': 1, 'image_id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c789f06-ccea-432e-92d4-09cfa0421b2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ef5e181cbd4f5f634e22176c8b311be2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4d7d3395dbb945a797121d5fb051bb12', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '85d764ae1723bafffe63ac7f21cfdfc6c04ae56015ebe5db8922a674d1bf60d3eea20d65fdc9d209e080c6a663905d77565e4977c0b3a8ba5abdefbf7fea453f', 'id': '8c789f06-ccea-432e-92d4-09cfa0421b2e', 'created_at': datetime.datetime(2026, 7, 6, 13, 46, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 13, 46, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c789f06-ccea-432e-92d4-09cfa0421b2e/file', 'properties': {}}, 'image_service': }' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:08 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 Jul 06 15:47:08 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19dc994b-6d54-4392-a56b-8a61bc3be803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Volume volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 (fa3c1c76-47bd-4f28-ab4d-fca516f041a2): created successfully Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19dc994b-6d54-4392-a56b-8a61bc3be803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Flow 'volume_create_manager' (3fa3cdb1-19df-4932-91d6-16549f948f5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7af99f50-a503-4d3d-abb4-87c4e03d5d8d tempest-VolumeImageDependencyTests-885193309 None] Created volume successfully. Jul 06 15:47:08 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.744s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Deleted volume successfully. Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-93d7db7a-d3d0-4cf8-b20e-4b8829ec64ee tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-8e072da8-9053-4c85-b880-7274adad4d8e-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Acquiring lock "cinder-fa3c1c76-47bd-4f28-ab4d-fca516f041a2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Lock "cinder-fa3c1c76-47bd-4f28-ab4d-fca516f041a2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Acquiring lock "cinder-quobyte-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Lock "cinder-quobyte-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:08 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68" returned: 0 in 0.985s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2a8e1-5d46-4762-8ab7-f26e9e893108]: (4, 'raw') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:08 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68 Jul 06 15:47:08 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:09 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 1073741824" returned: 0 in 1.087s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:09 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:47:09 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 Jul 06 15:47:09 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:09 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:09 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c3e9a630-5f4f-4fc4-8711-746bab313e68" returned: 0 in 0.658s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-c3e9a630-5f4f-4fc4-8711-746bab313e68" released by "delete_volume" :: held 1.727s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Created reservations ['b6bbb08a-ff06-4039-8cc4-1f753199296c', '93079bfb-756a-4afb-b207-6ca333407c88', 'e3e7850a-4006-478c-8e17-61eec813c460', '84c6ad70-a448-4ed6-8b0e-301e83d8ded7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:09 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 0 in 0.823s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:09 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:09 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:09 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647" returned: 0 in 0.746s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.809s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2165336f-f977-40c5-8384-4547f5fbeab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5a5d79-ec4d-40d4-8247-810180201647', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be400c7-d87e-4bae-8095-f341bd05c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Creating offline snapshot 6e5b6534-497e-44f8-baa3-50bef9de070f of volume 6745fded-7141-4678-83da-949d27893dca {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:09 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Volume volume-4e5a5d79-ec4d-40d4-8247-810180201647 (4e5a5d79-ec4d-40d4-8247-810180201647): created successfully Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be400c7-d87e-4bae-8095-f341bd05c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Flow 'volume_create_manager' (fe3fad94-ec68-41cb-b360-2f802d843fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d45ba91-aee3-4f63-a6e7-37496cf5f091]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-42f2acb8-b779-4e66-bdfb-04558275937b tempest-CinderUnicodeTest-79582333 None] Created volume successfully. Jul 06 15:47:09 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:47:09 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca Jul 06 15:47:10 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-448e52e3-ee74-4a84-942d-73c71486c56d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-448e52e3-ee74-4a84-942d-73c71486c56d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "cinder-quobyte-448e52e3-ee74-4a84-942d-73c71486c56d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-448e52e3-ee74-4a84-942d-73c71486c56d" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb6cec7-1829-4dd5-a8e1-e846f60b1d97]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:10 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d Jul 06 15:47:10 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Deleted volume successfully. Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-98a6ac1b-cef1-4faa-b89d-b9f0d2afa85f tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-c3e9a630-5f4f-4fc4-8711-746bab313e68-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:10 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca" returned: 0 in 0.837s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:10 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 1 in 0.959s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2' failed. Not Retrying. {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 15:47:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:10 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f 1G Jul 06 15:47:10 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:10 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2 Jul 06 15:47:10 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d" returned: 0 in 0.910s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d Jul 06 15:47:11 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:11 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" returned: 0 in 0.812s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Lock "cinder-quobyte-fa3c1c76-47bd-4f28-ab4d-fca516f041a2" released by "delete_volume" :: held 2.697s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Created reservations ['20f40345-d9ac-4224-a425-2d72798c1777', '96355ced-95b5-45a6-b150-d3bad2cef195', '70c23328-5844-4262-a5d7-d37f6f9b5892', 'de800810-7355-46fa-82f6-cb14bd1e24dd'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:11 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f 1G" returned: 0 in 0.968s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6745fded-7141-4678-83da-949d27893dca -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6745fded-7141-4678-83da-949d27893dca -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f Jul 06 15:47:11 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:11 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:11 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:11 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-448e52e3-ee74-4a84-942d-73c71486c56d" returned: 0 in 0.750s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-quobyte-448e52e3-ee74-4a84-942d-73c71486c56d" released by "delete_volume" :: held 1.720s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:11 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Created reservations ['c61d7200-07b4-4c72-8f4a-eab2373169c5', '8521b29d-db58-4d0c-b30f-1ff3cf610829', '8262d43b-29ae-4c42-b388-e2c2766d5d23', '8b38e608-7b6b-4452-994b-c6da11ba2dcb'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:12 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:12 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:12 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6745fded-7141-4678-83da-949d27893dca -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f is being set with open permissions: ugo+rw Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:12 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f Jul 06 15:47:12 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:12 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.827s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Deleted volume successfully. Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d91d423-43d3-4da2-92c3-3c9107fe0a15 tempest-VolumeImageDependencyTests-885193309 None] Lock "cinder-fa3c1c76-47bd-4f28-ab4d-fca516f041a2-delete_volume" released by "delete_volume" :: held 3.860s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:12 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Deleted volume successfully. Jul 06 15:47:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-585f6764-d5bc-4bd0-914c-22188f7ae0a5 tempest-CreateVolumesFromImageTest-2064699655 None] Lock "cinder-448e52e3-ee74-4a84-942d-73c71486c56d-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:13 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f" returned: 0 in 0.729s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:13 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info Jul 06 15:47:13 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:14 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info" returned: 0 in 0.795s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:14 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info is being set with open permissions: ugo+rw Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:14 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info Jul 06 15:47:14 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:14 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.info" returned: 0 in 0.707s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.021s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.541s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Creating offline snapshot 76bb3433-d526-4136-9184-d74eeb05e8e5 of volume 4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:14 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c26e263e-71d3-4455-be02-0b9c2adada53 tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb693a4-2d52-460e-a948-fd53d517d3a5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:15 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 Jul 06 15:47:15 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-6e5b6534-497e-44f8-baa3-50bef9de070f-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Lock "cinder-6e5b6534-497e-44f8-baa3-50bef9de070f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-6745fded-7141-4678-83da-949d27893dca" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-6745fded-7141-4678-83da-949d27893dca" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-6e5b6534-497e-44f8-baa3-50bef9de070f" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-6e5b6534-497e-44f8-baa3-50bef9de070f" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot 6e5b6534-497e-44f8-baa3-50bef9de070f of volume 6745fded-7141-4678-83da-949d27893dca {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[43beae97-80b0-488c-aba8-e37f7a95aa8d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:15 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f Jul 06 15:47:15 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:15 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647" returned: 0 in 0.956s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:15 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 1G Jul 06 15:47:15 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:16 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f" returned: 0 in 0.855s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6745fded-7141-4678-83da-949d27893dca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[919afccf-0753-47bd-be29-dd1210f67b95]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:16 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca Jul 06 15:47:16 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:16 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 1G" returned: 0 in 0.934s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5a5d79-ec4d-40d4-8247-810180201647 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:16 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5a5d79-ec4d-40d4-8247-810180201647 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 Jul 06 15:47:16 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:17 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-4b12d66e-f47d-4b1b-abcc-f2ee76679dac tempest-ProjectAdminTests-1125104654 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.755241394043, 'free_capacity_gb': 1775.755241394043, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86191) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 15:47:17 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca" returned: 0 in 0.828s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:17 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f Jul 06 15:47:17 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:17 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e5a5d79-ec4d-40d4-8247-810180201647 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:17 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 is being set with open permissions: ugo+rw Jul 06 15:47:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:17 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 Jul 06 15:47:17 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:18 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f" returned: 0 in 0.903s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:18 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f Jul 06 15:47:18 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:18 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5" returned: 0 in 0.743s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:18 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info Jul 06 15:47:18 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:18 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca.6e5b6534-497e-44f8-baa3-50bef9de070f" returned: 0 in 0.778s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-6e5b6534-497e-44f8-baa3-50bef9de070f" released by "_delete_snapshot" :: held 3.561s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:18 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-6745fded-7141-4678-83da-949d27893dca" released by "delete_snapshot" :: held 3.609s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Created reservations ['277fc1ea-2cfc-48c1-a1df-e330e49cd344', '8c11dddd-b61e-434a-8385-97b64bf7f18a', 'd332090f-6196-4bb3-842c-70efb1f190fe', 'a8668ba9-cd4d-46d4-a661-f695d330997a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2c27352c-e700-477d-90a9-612ce90b2c7c tempest-ProjectMemberTests-96922552 None] Lock "cinder-6e5b6534-497e-44f8-baa3-50bef9de070f-delete_snapshot" released by "delete_snapshot" :: held 3.852s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:19 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info" returned: 0 in 0.923s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:19 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info is being set with open permissions: ugo+rw Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:19 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info Jul 06 15:47:19 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-6745fded-7141-4678-83da-949d27893dca-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Lock "cinder-6745fded-7141-4678-83da-949d27893dca-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-6745fded-7141-4678-83da-949d27893dca" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-6745fded-7141-4678-83da-949d27893dca" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2f023-6d14-4689-bcd4-ec058ee41bfa]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:19 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca Jul 06 15:47:19 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:20 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.info" returned: 0 in 0.825s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.239s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3a507619-4cd7-4f90-b458-2985255202f3 tempest-CinderUnicodeTest-79582333 None] Create snapshot completed successfully Jul 06 15:47:20 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca" returned: 0 in 0.841s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:20 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca Jul 06 15:47:20 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-76bb3433-d526-4136-9184-d74eeb05e8e5-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-76bb3433-d526-4136-9184-d74eeb05e8e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-quobyte-4e5a5d79-ec4d-40d4-8247-810180201647" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-4e5a5d79-ec4d-40d4-8247-810180201647" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-quobyte-76bb3433-d526-4136-9184-d74eeb05e8e5" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-76bb3433-d526-4136-9184-d74eeb05e8e5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Deleting offline snapshot 76bb3433-d526-4136-9184-d74eeb05e8e5 of volume 4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:47:21 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] snapshot_file for this snap is: volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-6745fded-7141-4678-83da-949d27893dca" returned: 0 in 0.742s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca219b-88e2-4ca8-82a2-bb8a4aad9ca1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-6745fded-7141-4678-83da-949d27893dca" released by "delete_volume" :: held 1.663s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Created reservations ['070f806d-f3ff-429c-8ca5-5e6b2a32b50d', 'febe3a26-3d79-4851-9eef-728c8201257b', '663ca9d7-762e-4330-ac41-6c706330bada', 'a8212bb7-655a-4b1a-9966-68b5878b3a54'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:21 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 Jul 06 15:47:21 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:21 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:21 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:22 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5" returned: 0 in 0.929s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e5a5d79-ec4d-40d4-8247-810180201647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:22 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf1cdbb-a093-4522-9eba-8bbd58f7fef4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3a92c8a0-ffb5-49e6-9cf2-8ea7494b2d6e tempest-ProjectMemberTests-96922552 None] Lock "cinder-6745fded-7141-4678-83da-949d27893dca-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:22 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 Jul 06 15:47:22 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (062cbb45-2a16-4dc0-8bb8-d2f374b3e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09516cf4-5e71-457d-a4a0-478a7600acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09516cf4-5e71-457d-a4a0-478a7600acf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128190873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37beafd1-a197-4775-8dd5-4711932bc232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:23Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2300639-2fd3-4138-aa86-8cfc7cf80f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2300639-2fd3-4138-aa86-8cfc7cf80f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210df0ed-f5d7-42f5-8821-1f4b923c717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (210df0ed-f5d7-42f5-8821-1f4b923c717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37beafd1-a197-4775-8dd5-4711932bc232', 'volume_name': 'volume-37beafd1-a197-4775-8dd5-4711932bc232', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee05aa7-f5e4-439c-8921-6066ed15581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee05aa7-f5e4-439c-8921-6066ed15581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb081f-5075-45ab-b0f6-99fc78b3c869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:22 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Volume 37beafd1-a197-4775-8dd5-4711932bc232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37beafd1-a197-4775-8dd5-4711932bc232', 'volume_size': 1} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128190873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37beafd1-a197-4775-8dd5-4711932bc232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:23Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Creating volume 37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:22 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:22 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 1073741824 Jul 06 15:47:22 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:23 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647" returned: 0 in 0.979s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:23 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 Jul 06 15:47:23 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:23 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 1073741824" returned: 0 in 0.873s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:23 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 Jul 06 15:47:23 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:24 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5" returned: 0 in 0.895s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:24 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5 Jul 06 15:47:24 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:24 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232" returned: 0 in 0.782s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18fb081f-5075-45ab-b0f6-99fc78b3c869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37beafd1-a197-4775-8dd5-4711932bc232', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8102e7f-b698-4f5f-93da-bff6593ac425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Volume volume-37beafd1-a197-4775-8dd5-4711932bc232 (37beafd1-a197-4775-8dd5-4711932bc232): created successfully Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8102e7f-b698-4f5f-93da-bff6593ac425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (062cbb45-2a16-4dc0-8bb8-d2f374b3e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f9a3c834-50ac-4ed6-9e07-d1123b93f15d tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:47:25 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647.76bb3433-d526-4136-9184-d74eeb05e8e5" returned: 0 in 0.883s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Creating offline snapshot 889b4775-aa8e-48da-b29b-ae42fcf0c50d of volume 37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7f4f1-c91f-4e19-b900-deda354406e2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-76bb3433-d526-4136-9184-d74eeb05e8e5" released by "_delete_snapshot" :: held 3.873s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-4e5a5d79-ec4d-40d4-8247-810180201647" released by "delete_snapshot" :: held 3.901s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Created reservations ['8c7bcd1a-1b9e-4219-b18e-cf130472c9e0', '2ce8394e-cfe6-4e0e-8ddc-025378a0986e', '414c83b3-9256-443f-a8f5-8b5284569619', 'add23987-54dd-442e-80e0-9b8c9d646fbc'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:25 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 Jul 06 15:47:25 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Delete snapshot completed successfully. Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-3d1bd1d3-5762-4e7a-9b98-5fdf250fb6c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-76bb3433-d526-4136-9184-d74eeb05e8e5-delete_snapshot" released by "delete_snapshot" :: held 4.110s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-4e5a5d79-ec4d-40d4-8247-810180201647-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Lock "cinder-4e5a5d79-ec4d-40d4-8247-810180201647-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-quobyte-4e5a5d79-ec4d-40d4-8247-810180201647" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-4e5a5d79-ec4d-40d4-8247-810180201647" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9c99d-0706-4303-aca8-8b35809fdbb2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:25 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 Jul 06 15:47:25 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232" returned: 0 in 0.977s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:26 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d 1G Jul 06 15:47:26 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:26 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647" returned: 0 in 0.952s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:26 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647 Jul 06 15:47:26 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:27 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d 1G" returned: 0 in 1.019s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37beafd1-a197-4775-8dd5-4711932bc232 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:27 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37beafd1-a197-4775-8dd5-4711932bc232 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d Jul 06 15:47:27 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:27 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-4e5a5d79-ec4d-40d4-8247-810180201647" returned: 0 in 0.756s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-4e5a5d79-ec4d-40d4-8247-810180201647" released by "delete_volume" :: held 1.788s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Created reservations ['0ef62830-6d74-41e1-be99-d409e74613a9', '41a1a7bf-f418-45e1-b328-769e5fc814c2', '5bf48cef-65fa-4f60-bef7-fdff363e2ae5', '8550a636-950f-4d22-99d9-c5ea747589c7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:27 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:27 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-104060c9-65b7-4301-acf5-7a022393e7d3-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-104060c9-65b7-4301-acf5-7a022393e7d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "cinder-quobyte-104060c9-65b7-4301-acf5-7a022393e7d3" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-104060c9-65b7-4301-acf5-7a022393e7d3" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[87693caf-42dd-4e7d-85be-d275b2c047d3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:28 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37beafd1-a197-4775-8dd5-4711932bc232 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d" returned: 0 in 1.010s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d is being set with open permissions: ugo+rw Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:28 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d Jul 06 15:47:28 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:28 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 Jul 06 15:47:28 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:28 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.002s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Deleted volume successfully. Jul 06 15:47:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2a8d1dac-c30b-4990-aa97-54ab658fcf2b tempest-CinderUnicodeTest-79582333 None] Lock "cinder-4e5a5d79-ec4d-40d4-8247-810180201647-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:29 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d" returned: 0 in 0.847s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info Jul 06 15:47:29 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:29 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3" returned: 0 in 1.106s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3 Jul 06 15:47:29 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Flow 'volume_create_manager' (f6f9b6a0-e04c-440e-ab5e-66882f4bf60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f28500-c8e5-4b98-ab0c-1a797125ac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f28500-c8e5-4b98-ab0c-1a797125ac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220813483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8060a05d-40f6-47d9-bcbb-816a7936d439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474d38a4007a45af96a56c4f45fc67cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:30Z,use_quota=True,user_id='364a8570729442e08736527e27131aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306d0d56-0c6b-4091-9aed-17d5d9c5bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306d0d56-0c6b-4091-9aed-17d5d9c5bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4564f92d-13fa-49a0-ad03-81894face2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4564f92d-13fa-49a0-ad03-81894face2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8060a05d-40f6-47d9-bcbb-816a7936d439', 'volume_name': 'volume-8060a05d-40f6-47d9-bcbb-816a7936d439', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3558ca2b-3187-4395-937a-aceccae4e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3558ca2b-3187-4395-937a-aceccae4e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdcd644-c06a-4e3c-afc2-cba3141ac6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:29 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Volume 8060a05d-40f6-47d9-bcbb-816a7936d439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8060a05d-40f6-47d9-bcbb-816a7936d439', 'volume_size': 1} Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:29 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info" returned: 0 in 0.799s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:29 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info is being set with open permissions: ugo+rw Jul 06 15:47:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:29 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info Jul 06 15:47:29 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:30 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-104060c9-65b7-4301-acf5-7a022393e7d3" returned: 0 in 0.720s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-quobyte-104060c9-65b7-4301-acf5-7a022393e7d3" released by "delete_volume" :: held 1.883s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Created reservations ['60d2a8b1-b0bd-4dd2-b43e-6dd8988363b8', '790a6984-02c4-4be3-a9a0-35be3b76d761', '8514b931-641f-486b-9410-2625287f895c', '2901ce68-0e7b-4c9f-a157-14c55b190199'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:30 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:30 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:30 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.info" returned: 0 in 0.751s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.534s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220813483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8060a05d-40f6-47d9-bcbb-816a7936d439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474d38a4007a45af96a56c4f45fc67cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:30Z,use_quota=True,user_id='364a8570729442e08736527e27131aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Creating volume 8060a05d-40f6-47d9-bcbb-816a7936d439 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:30 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:30 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 1073741824 Jul 06 15:47:30 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-50b22273-b246-464c-b6fd-41c02922e05e tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:47:30 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.801s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:30 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:30 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Deleted volume successfully. Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0c106bc2-9f4b-4e85-8200-1d644ba7b1c6 tempest-CinderUnicodeTest-79582333 None] Lock "cinder-104060c9-65b7-4301-acf5-7a022393e7d3-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-889b4775-aa8e-48da-b29b-ae42fcf0c50d-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Lock "cinder-889b4775-aa8e-48da-b29b-ae42fcf0c50d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-37beafd1-a197-4775-8dd5-4711932bc232" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-37beafd1-a197-4775-8dd5-4711932bc232" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-889b4775-aa8e-48da-b29b-ae42fcf0c50d" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-889b4775-aa8e-48da-b29b-ae42fcf0c50d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot 889b4775-aa8e-48da-b29b-ae42fcf0c50d of volume 37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe556bf-452d-4ceb-ad40-9b1d42ca6780]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:31 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d Jul 06 15:47:31 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:31 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 1073741824" returned: 0 in 1.138s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (59a38472-092a-41d3-9106-5a0e437ddc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed06712-ce29-424e-a27d-05249e69094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aed06712-ce29-424e-a27d-05249e69094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789179609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc90746c-b7b2-4d90-9915-c0eb9e4cf802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:32Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0953fe-6941-4a60-bd56-d3a9f0c58429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b0953fe-6941-4a60-bd56-d3a9f0c58429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3b8965-b62d-4ba8-87a3-3c966a9a7a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3b8965-b62d-4ba8-87a3-3c966a9a7a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc90746c-b7b2-4d90-9915-c0eb9e4cf802', 'volume_name': 'volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:31 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb1b07a-84f2-42a9-bdcd-7e2f42d14603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb1b07a-84f2-42a9-bdcd-7e2f42d14603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5011b9-84f7-4c7d-b27f-1b0aa891fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Volume fc90746c-b7b2-4d90-9915-c0eb9e4cf802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802', 'volume_size': 1} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:32 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 Jul 06 15:47:32 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:32 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d" returned: 0 in 0.926s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37beafd1-a197-4775-8dd5-4711932bc232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5998f0b-63dc-430c-a2a8-87ef85f3a1d5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:32 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 Jul 06 15:47:32 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:32 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439" returned: 0 in 0.653s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789179609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc90746c-b7b2-4d90-9915-c0eb9e4cf802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:32Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Creating volume fc90746c-b7b2-4d90-9915-c0eb9e4cf802 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:32 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdcd644-c06a-4e3c-afc2-cba3141ac6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8060a05d-40f6-47d9-bcbb-816a7936d439', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:32 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 1073741824 Jul 06 15:47:32 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f952bc5d-fd53-4a73-93f5-06807594ecde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Volume volume-8060a05d-40f6-47d9-bcbb-816a7936d439 (8060a05d-40f6-47d9-bcbb-816a7936d439): created successfully Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f952bc5d-fd53-4a73-93f5-06807594ecde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Flow 'volume_create_manager' (f6f9b6a0-e04c-440e-ab5e-66882f4bf60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:32 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-783ea82b-db50-4639-9642-e42b30ee09bc tempest-ProjectReaderTests-1274775011 None] Created volume successfully. Jul 06 15:47:33 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232" returned: 0 in 0.886s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:33 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d Jul 06 15:47:33 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:33 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 1073741824" returned: 0 in 0.916s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:33 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 Jul 06 15:47:33 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Acquiring lock "cinder-8060a05d-40f6-47d9-bcbb-816a7936d439-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-8060a05d-40f6-47d9-bcbb-816a7936d439-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:34 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d" returned: 0 in 0.821s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:34 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d Jul 06 15:47:34 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Acquiring lock "cinder-quobyte-8060a05d-40f6-47d9-bcbb-816a7936d439" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-quobyte-8060a05d-40f6-47d9-bcbb-816a7936d439" acquired by "delete_volume" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5188a28a-f5b1-400c-a1b0-0c2c18250e3d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:34 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802" returned: 0 in 0.729s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5011b9-84f7-4c7d-b27f-1b0aa891fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44585979-01fb-44e1-8f82-49f04035c572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:34 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Volume volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 (fc90746c-b7b2-4d90-9915-c0eb9e4cf802): created successfully Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44585979-01fb-44e1-8f82-49f04035c572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:34 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 Jul 06 15:47:34 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (59a38472-092a-41d3-9106-5a0e437ddc43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-06dd9aba-774c-4c47-bde0-1479886d675e tempest-ProjectReaderTests-1717834812 None] Created volume successfully. Jul 06 15:47:34 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232.889b4775-aa8e-48da-b29b-ae42fcf0c50d" returned: 0 in 0.671s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-889b4775-aa8e-48da-b29b-ae42fcf0c50d" released by "_delete_snapshot" :: held 3.447s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-37beafd1-a197-4775-8dd5-4711932bc232" released by "delete_snapshot" :: held 3.485s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Created reservations ['4b76a3df-fde9-418e-b579-3465dbcd138e', 'ba2ddfcf-6b99-4fd3-a8e7-66040584af42', 'af3b11d1-3adf-44e5-b64f-89dfe73fbd50', '45125ce2-fec6-4b98-99c2-ad80649f9f50'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:35 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:47:35 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-d04675f1-db40-4d03-b9e4-75ef60c0a65d tempest-ProjectMemberTests-96922552 None] Lock "cinder-889b4775-aa8e-48da-b29b-ae42fcf0c50d-delete_snapshot" released by "delete_snapshot" :: held 3.682s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439" returned: 0 in 0.823s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:35 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439 Jul 06 15:47:35 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-fc90746c-b7b2-4d90-9915-c0eb9e4cf802-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-fc90746c-b7b2-4d90-9915-c0eb9e4cf802-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-quobyte-fc90746c-b7b2-4d90-9915-c0eb9e4cf802" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-fc90746c-b7b2-4d90-9915-c0eb9e4cf802" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[472aa363-5773-48b3-a348-1c7f1987222f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:35 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 Jul 06 15:47:35 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-37beafd1-a197-4775-8dd5-4711932bc232-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Lock "cinder-37beafd1-a197-4775-8dd5-4711932bc232-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-37beafd1-a197-4775-8dd5-4711932bc232" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-37beafd1-a197-4775-8dd5-4711932bc232" acquired by "delete_volume" :: waited 0.026s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:35 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8060a05d-40f6-47d9-bcbb-816a7936d439" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dbe22b-b6d2-4f2a-ace4-4d436fdba1f9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-quobyte-8060a05d-40f6-47d9-bcbb-816a7936d439" released by "delete_volume" :: held 1.723s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Created reservations ['34437f39-498d-4363-bfdf-a39ec3411847', '71d05ae0-1f6c-4e9d-aa7e-1e9c117b5e2e', '1e00e335-c204-4b96-a37f-3d0187e72ab1', '084a4062-d5ea-4411-8b68-1dfec5442f53'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:36 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 Jul 06 15:47:36 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:36 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:36 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:36 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802" returned: 0 in 0.813s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:36 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802 Jul 06 15:47:36 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:36 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232" returned: 0 in 0.958s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:36 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232 Jul 06 15:47:36 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:36 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.843s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:36 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:36 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Deleted volume successfully. Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-7e1e4a00-aaa4-4b82-a342-38d394c225a1 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-8060a05d-40f6-47d9-bcbb-816a7936d439-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:37 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fc90746c-b7b2-4d90-9915-c0eb9e4cf802" returned: 0 in 0.838s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-fc90746c-b7b2-4d90-9915-c0eb9e4cf802" released by "delete_volume" :: held 1.718s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Flow 'volume_create_manager' (62dd72d4-ccb1-452e-b2a1-f1c64d06bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4661115d-48c5-47b3-8bc5-9ad831c163e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4661115d-48c5-47b3-8bc5-9ad831c163e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749409486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259ce58c-e861-4c29-afa1-0e752956cb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474d38a4007a45af96a56c4f45fc67cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:37Z,use_quota=True,user_id='364a8570729442e08736527e27131aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb4c5a7-21d0-4bc4-96dd-858757a3f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb4c5a7-21d0-4bc4-96dd-858757a3f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4531e7c9-23c4-4384-aa8d-767f224bd1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4531e7c9-23c4-4384-aa8d-767f224bd1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259ce58c-e861-4c29-afa1-0e752956cb9f', 'volume_name': 'volume-259ce58c-e861-4c29-afa1-0e752956cb9f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb170dea-4ed1-4e35-ab92-984545570329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb170dea-4ed1-4e35-ab92-984545570329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b7bd26-9277-4abc-ba71-eefb4c6fd6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:37 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Volume 259ce58c-e861-4c29-afa1-0e752956cb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259ce58c-e861-4c29-afa1-0e752956cb9f', 'volume_size': 1} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749409486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259ce58c-e861-4c29-afa1-0e752956cb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474d38a4007a45af96a56c4f45fc67cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:37Z,use_quota=True,user_id='364a8570729442e08736527e27131aa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Creating volume 259ce58c-e861-4c29-afa1-0e752956cb9f {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:37 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:37 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f 1073741824 Jul 06 15:47:37 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Created reservations ['893abe89-1192-4ca5-988e-3de853ff97d7', '3455c41e-106a-4704-ae1b-b0e3c55008fa', 'f1fef8e0-e8fa-4daf-856b-58d84d9aea6c', '1c16709f-91c7-4722-b877-b9942b2ed92d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:37 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:37 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:37 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-37beafd1-a197-4775-8dd5-4711932bc232" returned: 0 in 0.813s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-37beafd1-a197-4775-8dd5-4711932bc232" released by "delete_volume" :: held 1.867s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:37 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Created reservations ['a19f74d2-31c6-4947-bafc-f74bbb668ed1', 'f9f1768e-340f-4bdc-a1b3-4e64a4a81d5e', '0a087db4-ed01-49ff-9885-c1971dad9211', 'c8d9f12f-6b77-4651-b322-10b888b4bad3'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:38 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:38 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:38 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f 1073741824" returned: 0 in 1.121s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:38 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 1.026s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Deleted volume successfully. Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-c4e64b1e-45e2-4169-b820-20b0e38c0c95 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-fc90746c-b7b2-4d90-9915-c0eb9e4cf802-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:38 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f Jul 06 15:47:38 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (a5555db9-8ea0-4e24-b561-d43df196c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf28faa-93b3-44ea-90ca-5cae2ed57d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf28faa-93b3-44ea-90ca-5cae2ed57d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123890691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5bc213-81fa-49f7-8533-836d0a956037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:39Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb2ce5a-638d-458a-a4a2-18a86fdc4311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb2ce5a-638d-458a-a4a2-18a86fdc4311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d4d239-ad83-46be-b51b-6316ab5b972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:38 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d4d239-ad83-46be-b51b-6316ab5b972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5bc213-81fa-49f7-8533-836d0a956037', 'volume_name': 'volume-da5bc213-81fa-49f7-8533-836d0a956037', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee1d612-cc9d-42a7-ac2f-f7e83a22961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee1d612-cc9d-42a7-ac2f-f7e83a22961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7bcc89-7e30-4e98-a0b9-8f92ba60133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:38 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Volume da5bc213-81fa-49f7-8533-836d0a956037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5bc213-81fa-49f7-8533-836d0a956037', 'volume_size': 1} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.907s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (60eae639-fed1-4fb6-a4ce-f082ca6cf04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38e5e78-9ab2-424f-9d84-eb35091d4dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38e5e78-9ab2-424f-9d84-eb35091d4dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432002716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e3870e-68ed-418d-addb-e07bf8b816a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:39Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e44655c-99cf-4629-adc0-92f55f221841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e44655c-99cf-4629-adc0-92f55f221841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17487b03-9499-43ff-b777-ee31613d14d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17487b03-9499-43ff-b777-ee31613d14d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e3870e-68ed-418d-addb-e07bf8b816a2', 'volume_name': 'volume-c7e3870e-68ed-418d-addb-e07bf8b816a2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ed902c-f749-4465-a698-d029fcd98af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ed902c-f749-4465-a698-d029fcd98af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f0dfd3-7e9d-4bfb-8e01-7dd5ca5354eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:39 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Volume c7e3870e-68ed-418d-addb-e07bf8b816a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e3870e-68ed-418d-addb-e07bf8b816a2', 'volume_size': 1} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e7bc5f3c-d2e7-4471-8e79-bbbc88fa4d25 tempest-ProjectMemberTests-96922552 None] Lock "cinder-37beafd1-a197-4775-8dd5-4711932bc232-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:39 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f" returned: 0 in 0.758s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.255s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-123890691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5bc213-81fa-49f7-8533-836d0a956037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:39Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Creating volume da5bc213-81fa-49f7-8533-836d0a956037 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:39 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:39 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 1073741824 Jul 06 15:47:39 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24b7bd26-9277-4abc-ba71-eefb4c6fd6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259ce58c-e861-4c29-afa1-0e752956cb9f', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad96d7b-16e0-4fc2-90f5-17dfaac14780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:39 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Volume volume-259ce58c-e861-4c29-afa1-0e752956cb9f (259ce58c-e861-4c29-afa1-0e752956cb9f): created successfully Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad96d7b-16e0-4fc2-90f5-17dfaac14780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:39 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Flow 'volume_create_manager' (62dd72d4-ccb1-452e-b2a1-f1c64d06bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:39 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c5498467-92f8-4210-8eb5-9a5e30c5256c tempest-ProjectReaderTests-1274775011 None] Created volume successfully. Jul 06 15:47:40 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 1073741824" returned: 0 in 0.863s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:40 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 Jul 06 15:47:40 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Acquiring lock "cinder-259ce58c-e861-4c29-afa1-0e752956cb9f-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-259ce58c-e861-4c29-afa1-0e752956cb9f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Acquiring lock "cinder-quobyte-259ce58c-e861-4c29-afa1-0e752956cb9f" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-quobyte-259ce58c-e861-4c29-afa1-0e752956cb9f" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae235acc-cdc5-413f-b11c-45569f7e1afc]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:40 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f Jul 06 15:47:40 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:40 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037" returned: 0 in 0.764s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432002716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e3870e-68ed-418d-addb-e07bf8b816a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:39Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Creating volume c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:40 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae7bcc89-7e30-4e98-a0b9-8f92ba60133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5bc213-81fa-49f7-8533-836d0a956037', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:40 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 1073741824 Jul 06 15:47:40 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ea0004-0079-4f7e-b991-f3455fa248e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:40 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Volume volume-da5bc213-81fa-49f7-8533-836d0a956037 (da5bc213-81fa-49f7-8533-836d0a956037): created successfully Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ea0004-0079-4f7e-b991-f3455fa248e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:40 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (a5555db9-8ea0-4e24-b561-d43df196c092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:40 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7078fd09-510a-4eaa-b56a-4ada99368109 tempest-ProjectReaderTests-1717834812 None] Created volume successfully. Jul 06 15:47:41 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f" returned: 0 in 0.882s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:41 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f Jul 06 15:47:41 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-da5bc213-81fa-49f7-8533-836d0a956037-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Lock "cinder-da5bc213-81fa-49f7-8533-836d0a956037-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-quobyte-da5bc213-81fa-49f7-8533-836d0a956037" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-da5bc213-81fa-49f7-8533-836d0a956037" acquired by "delete_volume" :: waited 0.036s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c49ba-9cba-484f-981f-139ce67c25a6]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:41 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 1073741824" returned: 0 in 1.034s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:41 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 Jul 06 15:47:41 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:42 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 Jul 06 15:47:42 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:42 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-259ce58c-e861-4c29-afa1-0e752956cb9f" returned: 0 in 0.732s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-quobyte-259ce58c-e861-4c29-afa1-0e752956cb9f" released by "delete_volume" :: held 1.686s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Created reservations ['75109a53-9416-46c0-aa78-5f2c17cce003', 'a95062f3-a908-4876-ad7c-27749c3a4a41', '95ba5882-e218-4cda-963e-5568dfdaf554', '381a1dfd-85c6-4716-9972-4c535e31a1e0'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:42 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:42 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:42 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2" returned: 0 in 0.669s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f0dfd3-7e9d-4bfb-8e01-7dd5ca5354eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e3870e-68ed-418d-addb-e07bf8b816a2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e399aa06-2ca1-4e78-a9b4-4377cbda055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:42 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Volume volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 (c7e3870e-68ed-418d-addb-e07bf8b816a2): created successfully Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e399aa06-2ca1-4e78-a9b4-4377cbda055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (60eae639-fed1-4fb6-a4ce-f082ca6cf04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-42b50c39-bea1-4c13-8118-953f54891de1 tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:47:42 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037" returned: 0 in 0.920s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:42 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037 Jul 06 15:47:42 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:43 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.889s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:43 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Deleted volume successfully. Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-caa545b1-7f69-4e79-91ee-4335de5c9159 tempest-ProjectReaderTests-1274775011 None] Lock "cinder-259ce58c-e861-4c29-afa1-0e752956cb9f-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Creating offline snapshot 7da250af-078e-4984-9754-081b42c5fa16 of volume c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef0336-9f88-4447-bf6c-53b953ef3c00]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:43 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 Jul 06 15:47:43 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:43 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-da5bc213-81fa-49f7-8533-836d0a956037" returned: 0 in 0.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-da5bc213-81fa-49f7-8533-836d0a956037" released by "delete_volume" :: held 1.690s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Created reservations ['b96ed57e-504c-4b18-be62-1dc149d09469', 'c715030c-5fec-468c-bed9-03ceeea61fba', 'fb96e4df-24ad-4a75-8a44-414b42a3da2c', 'dd2b70f1-6926-4583-88f4-0c0ba99dddeb'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:43 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:43 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:44 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2" returned: 0 in 0.936s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:44 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 1G Jul 06 15:47:44 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:44 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.743s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:44 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Deleted volume successfully. Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-39d3d33e-3b54-412b-98a1-c62a5909f76e tempest-ProjectReaderTests-1717834812 None] Lock "cinder-da5bc213-81fa-49f7-8533-836d0a956037-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (ad6e0075-ec86-45bd-9753-2403bc274a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa68dc90-b717-449a-960e-f62c25486e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa68dc90-b717-449a-960e-f62c25486e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102913914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748ca577-1b11-46f1-8e35-6a413520c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:45Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc166ce-7396-4860-b78e-8df8225b4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfc166ce-7396-4860-b78e-8df8225b4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97452dcd-a5bb-4853-8bff-77b0b46f9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97452dcd-a5bb-4853-8bff-77b0b46f9fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748ca577-1b11-46f1-8e35-6a413520c547', 'volume_name': 'volume-748ca577-1b11-46f1-8e35-6a413520c547', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfe6328-9321-42a7-a281-a4308ffff175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bfe6328-9321-42a7-a281-a4308ffff175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29f29d3-e05e-4db6-8568-291053bffa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:44 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Volume 748ca577-1b11-46f1-8e35-6a413520c547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748ca577-1b11-46f1-8e35-6a413520c547', 'volume_size': 1} Jul 06 15:47:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:45 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 1G" returned: 0 in 0.969s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:45 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 Jul 06 15:47:45 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:45 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16" returned: 0 in 0.704s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:45 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 is being set with open permissions: ugo+rw Jul 06 15:47:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:45 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 Jul 06 15:47:45 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:46 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16" returned: 0 in 0.609s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:46 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info Jul 06 15:47:46 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:47 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info" returned: 0 in 0.632s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:47 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info is being set with open permissions: ugo+rw Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:47 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info Jul 06 15:47:47 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:47 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.info" returned: 0 in 0.675s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.607s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102913914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748ca577-1b11-46f1-8e35-6a413520c547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:45Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Creating volume 748ca577-1b11-46f1-8e35-6a413520c547 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:47 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:47 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 1073741824 Jul 06 15:47:47 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7cf23946-424b-4dda-a4ed-711d19e71941 tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-7da250af-078e-4984-9754-081b42c5fa16-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Lock "cinder-7da250af-078e-4984-9754-081b42c5fa16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-c7e3870e-68ed-418d-addb-e07bf8b816a2" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-c7e3870e-68ed-418d-addb-e07bf8b816a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-7da250af-078e-4984-9754-081b42c5fa16" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-7da250af-078e-4984-9754-081b42c5fa16" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot 7da250af-078e-4984-9754-081b42c5fa16 of volume c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a5f14-9752-4f61-a83b-057570e13ffd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:48 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 Jul 06 15:47:48 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:48 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 1073741824" returned: 0 in 0.852s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:48 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 Jul 06 15:47:48 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:49 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16" returned: 0 in 0.780s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e3870e-68ed-418d-addb-e07bf8b816a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c8035-0ea8-4688-8c03-4c3cca6186c7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:49 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547" returned: 0 in 0.640s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29f29d3-e05e-4db6-8568-291053bffa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748ca577-1b11-46f1-8e35-6a413520c547', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a43949-c7f6-48cc-9ed3-ce3bb54b2044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Volume volume-748ca577-1b11-46f1-8e35-6a413520c547 (748ca577-1b11-46f1-8e35-6a413520c547): created successfully Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a43949-c7f6-48cc-9ed3-ce3bb54b2044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (ad6e0075-ec86-45bd-9753-2403bc274a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9fbb83f1-263d-40b5-b5d0-1b76333998ed tempest-ProjectReaderTests-1717834812 None] Created volume successfully. Jul 06 15:47:49 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 Jul 06 15:47:49 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-748ca577-1b11-46f1-8e35-6a413520c547-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-748ca577-1b11-46f1-8e35-6a413520c547-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-quobyte-748ca577-1b11-46f1-8e35-6a413520c547" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:50 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2" returned: 0 in 0.759s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-748ca577-1b11-46f1-8e35-6a413520c547" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:50 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 Jul 06 15:47:50 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f773680-d421-4556-bd85-c79d7efb919c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:50 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 Jul 06 15:47:50 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:50 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16" returned: 0 in 0.738s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:50 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16 Jul 06 15:47:50 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:51 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547" returned: 0 in 0.857s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:51 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547 Jul 06 15:47:51 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:51 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2.7da250af-078e-4984-9754-081b42c5fa16" returned: 0 in 0.673s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-7da250af-078e-4984-9754-081b42c5fa16" released by "_delete_snapshot" :: held 3.048s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-c7e3870e-68ed-418d-addb-e07bf8b816a2" released by "delete_snapshot" :: held 3.076s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Created reservations ['e82b0c33-0341-4a34-86ed-bea2b3d572e5', 'f76b1508-9595-42f0-a9cb-8dbb10a2d328', '35f97ce9-488c-4b9a-9f96-04c8538659c2', 'c7c3f8e5-1ef9-4d88-af85-ff1d6f27af22'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:51 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-748ca577-1b11-46f1-8e35-6a413520c547" returned: 0 in 0.688s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f05f2bfa-6c32-4da9-9ce1-e25652d8e903 tempest-ProjectMemberTests-96922552 None] Lock "cinder-7da250af-078e-4984-9754-081b42c5fa16-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-748ca577-1b11-46f1-8e35-6a413520c547" released by "delete_volume" :: held 1.593s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Created reservations ['f13780a9-7f4f-491c-a200-68245d7bae35', '871e4d9b-098a-44e2-a862-6ad2e9e7b23e', 'aefe2577-e6b5-4801-8a33-2bfa682d5f4d', '6cb4f54a-a4e8-48a3-8fcd-b1fcfa33af61'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:51 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:51 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:52 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.640s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Deleted volume successfully. Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1d74b9ca-45d0-4b5e-8f04-ceabfcacd4f1 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-748ca577-1b11-46f1-8e35-6a413520c547-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-c7e3870e-68ed-418d-addb-e07bf8b816a2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-c7e3870e-68ed-418d-addb-e07bf8b816a2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-c7e3870e-68ed-418d-addb-e07bf8b816a2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-c7e3870e-68ed-418d-addb-e07bf8b816a2" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[170570ea-10ec-4bfd-80bb-11ab768f2364]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (a5d26b92-dac0-406a-9c22-8a5db0948f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9575e4c2-5603-4a3e-afcc-0a5ad3b92237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9575e4c2-5603-4a3e-afcc-0a5ad3b92237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041039968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a3ceb-e392-44bc-9cf4-e25d91b34af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:53Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f9c739-8124-4cd0-aab7-5c078ff975d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f9c739-8124-4cd0-aab7-5c078ff975d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218df269-b944-43e4-9d23-789f7ee9dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218df269-b944-43e4-9d23-789f7ee9dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1a3ceb-e392-44bc-9cf4-e25d91b34af2', 'volume_name': 'volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efe8027-53e0-4422-83ad-be3296c24938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efe8027-53e0-4422-83ad-be3296c24938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48e378d-38c2-439a-ba74-0637ceed9c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:52 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Volume fd1a3ceb-e392-44bc-9cf4-e25d91b34af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2', 'volume_size': 1} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041039968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1a3ceb-e392-44bc-9cf4-e25d91b34af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15c8cffe52b74785a4358250f79ee5fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:53Z,use_quota=True,user_id='5617e8134aa649f8b5cfd2582a130c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Creating volume fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:52 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 Jul 06 15:47:52 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:52 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:52 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 1073741824 Jul 06 15:47:52 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:53 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2" returned: 0 in 0.770s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:53 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2 Jul 06 15:47:53 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:53 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 1073741824" returned: 0 in 0.840s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:53 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 Jul 06 15:47:53 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:54 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-c7e3870e-68ed-418d-addb-e07bf8b816a2" returned: 0 in 0.652s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-c7e3870e-68ed-418d-addb-e07bf8b816a2" released by "delete_volume" :: held 1.505s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Created reservations ['22676082-aae6-46cb-a5e3-b61bf235159e', '4ee7aa12-e19c-493d-b740-e03d04be9dfa', '7cf96ec7-cf7d-476e-8c85-0768df70b671', '9ea42751-21ec-4ea1-8e49-4deec2d575f6'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:54 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:54 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:54 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2" returned: 0 in 0.650s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48e378d-38c2-439a-ba74-0637ceed9c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f734f7-9674-4bb4-9b0e-93c6696b8f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:54 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Volume volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 (fd1a3ceb-e392-44bc-9cf4-e25d91b34af2): created successfully Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f734f7-9674-4bb4-9b0e-93c6696b8f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Flow 'volume_create_manager' (a5d26b92-dac0-406a-9c22-8a5db0948f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:54 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-227c982e-5a3f-4a7a-88e2-d68ff316f822 tempest-ProjectReaderTests-1717834812 None] Created volume successfully. Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:54 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "cinder-quobyte-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2" acquired by "delete_volume" :: waited 0.029s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:47:55 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb24e6d3-422c-4df2-ac2c-99d9e29ccd93]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.688s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-0367b9e1-37f2-439a-9532-27fbc937b1a4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-c7e3870e-68ed-418d-addb-e07bf8b816a2-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:55 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 Jul 06 15:47:55 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (a9f35bdf-4582-454e-9f9c-05b819e7e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f633398-5045-473a-bad4-807786adccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f633398-5045-473a-bad4-807786adccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226899566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d23b707-73a8-4669-a852-d0768ecbbdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:55Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe0a083-ca88-40ea-b28e-ac3bbb6f03ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe0a083-ca88-40ea-b28e-ac3bbb6f03ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e450423-d6ee-481e-b250-9c172ab6eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e450423-d6ee-481e-b250-9c172ab6eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d23b707-73a8-4669-a852-d0768ecbbdf1', 'volume_name': 'volume-1d23b707-73a8-4669-a852-d0768ecbbdf1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ba5f53-d06b-493b-b1aa-1f964d7ef2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ba5f53-d06b-493b-b1aa-1f964d7ef2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f869170-e38e-4c60-ba0c-d4ce3bc1f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:55 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Volume 1d23b707-73a8-4669-a852-d0768ecbbdf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d23b707-73a8-4669-a852-d0768ecbbdf1', 'volume_size': 1} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226899566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d23b707-73a8-4669-a852-d0768ecbbdf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:47:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:47:55Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Creating volume 1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:47:55 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:55 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 1073741824 Jul 06 15:47:55 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:55 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2" returned: 0 in 0.762s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:55 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2 Jul 06 15:47:55 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:56 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 1073741824" returned: 0 in 0.821s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:56 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 Jul 06 15:47:56 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:56 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2" returned: 0 in 0.676s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-quobyte-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2" released by "delete_volume" :: held 1.496s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Created reservations ['b6d005f5-a874-47fb-99e8-5e2dd3459fbd', '1f1a6bf4-280f-414e-b56d-810e2e5182af', 'aead856d-6de6-45c2-bc4d-1cede5eb975c', 'a198d8a6-9bf2-4a89-bd04-b97241836cf9'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:56 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:47:56 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:57 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1" returned: 0 in 0.619s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f869170-e38e-4c60-ba0c-d4ce3bc1f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d23b707-73a8-4669-a852-d0768ecbbdf1', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1853dee0-80c7-47b1-845f-d04cd597efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:47:57 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Volume volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 (1d23b707-73a8-4669-a852-d0768ecbbdf1): created successfully Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1853dee0-80c7-47b1-845f-d04cd597efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (a9f35bdf-4582-454e-9f9c-05b819e7e77e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:47:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0e9b46af-8bbe-4386-ade5-b5c6e45cc478 tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:47:57 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.662s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:47:57 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Deleted volume successfully. Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b8b40d6b-8c3a-4159-9ad7-433ccb652297 tempest-ProjectReaderTests-1717834812 None] Lock "cinder-fd1a3ceb-e392-44bc-9cf4-e25d91b34af2-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Creating offline snapshot d40685e1-1631-40e4-9a97-4e3c3290f075 of volume 1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3e25b2-36b2-473a-9a83-7e1810594a6f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:47:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:57 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 Jul 06 15:47:57 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:58 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1" returned: 0 in 0.816s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:58 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 1G Jul 06 15:47:58 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:59 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 1G" returned: 0 in 0.797s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:47:59 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 Jul 06 15:47:59 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:47:59 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jul 06 15:47:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075" returned: 0 in 0.663s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:47:59 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 is being set with open permissions: ugo+rw Jul 06 15:47:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:00 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 Jul 06 15:48:00 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:00 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075" returned: 0 in 0.610s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:00 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info Jul 06 15:48:00 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:01 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info" returned: 0 in 0.618s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:01 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info is being set with open permissions: ugo+rw Jul 06 15:48:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:01 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info Jul 06 15:48:01 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:01 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.info" returned: 0 in 0.633s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:01 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=215,cinder:SELECT=152,cinder:INSERT=58,cinder:DELETE=15 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:48:01 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=143,cinder:INSERT=51,cinder:UPDATE=191,cinder:DELETE=19 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:48:01 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-c5df3dd4-27c6-4ce2-a1c7-9027a2131dee tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-d40685e1-1631-40e4-9a97-4e3c3290f075-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Lock "cinder-d40685e1-1631-40e4-9a97-4e3c3290f075-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-1d23b707-73a8-4669-a852-d0768ecbbdf1" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1d23b707-73a8-4669-a852-d0768ecbbdf1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-d40685e1-1631-40e4-9a97-4e3c3290f075" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-d40685e1-1631-40e4-9a97-4e3c3290f075" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot d40685e1-1631-40e4-9a97-4e3c3290f075 of volume 1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef41d1-62ce-4964-8b8e-7c88a7c50d4f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:03 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 Jul 06 15:48:03 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:03 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075" returned: 0 in 0.775s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d23b707-73a8-4669-a852-d0768ecbbdf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:03 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c438f0-1cab-46a1-8679-d9ec66ccec49]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:03 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 Jul 06 15:48:03 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:04 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1" returned: 0 in 0.742s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:04 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 Jul 06 15:48:04 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:05 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075" returned: 0 in 0.692s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:05 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075 Jul 06 15:48:05 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:05 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1.d40685e1-1631-40e4-9a97-4e3c3290f075" returned: 0 in 0.637s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-d40685e1-1631-40e4-9a97-4e3c3290f075" released by "_delete_snapshot" :: held 2.942s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:05 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1d23b707-73a8-4669-a852-d0768ecbbdf1" released by "delete_snapshot" :: held 2.967s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:05 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Created reservations ['6631848e-bee2-49bc-97d8-74b628edf833', '0d83c5ec-2cc8-4cc8-8d71-5ffef72133eb', 'ed1f1ab9-51b9-467c-aa7f-1c39e42a9703', '63a1e79f-d911-4953-9be2-59117453870b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:06 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-58c52ba1-7524-4414-a3c3-44044239e94e tempest-ProjectMemberTests-96922552 None] Lock "cinder-d40685e1-1631-40e4-9a97-4e3c3290f075-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-1d23b707-73a8-4669-a852-d0768ecbbdf1-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Lock "cinder-1d23b707-73a8-4669-a852-d0768ecbbdf1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-1d23b707-73a8-4669-a852-d0768ecbbdf1" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1d23b707-73a8-4669-a852-d0768ecbbdf1" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[809a530b-68b8-407e-97d3-e00d41d0c0b9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:06 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 Jul 06 15:48:06 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:06 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:48:06 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:06 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1" returned: 0 in 0.766s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:07 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1 Jul 06 15:48:07 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:07 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.653s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:48:07 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1d23b707-73a8-4669-a852-d0768ecbbdf1" returned: 0 in 0.647s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1d23b707-73a8-4669-a852-d0768ecbbdf1" released by "delete_volume" :: held 1.473s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Created reservations ['4b3ab637-9b34-42da-bd28-1bbbd1e8ac04', '9c9347f6-48e9-42af-bc9f-fef116b5343c', '384d9a8d-8767-48f1-bcff-768840656568', 'c2e06e4d-5661-4eed-9cb1-1b4181ad6051'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:07 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:48:07 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:08 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.669s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:08 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-09c1381b-2231-49dd-83d7-cad1f9f39015 tempest-ProjectMemberTests-96922552 None] Lock "cinder-1d23b707-73a8-4669-a852-d0768ecbbdf1-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (7b6e852c-ed4e-4383-a34a-6ea3065780be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511cb189-d48d-4b6b-91f4-b68ecff3c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511cb189-d48d-4b6b-91f4-b68ecff3c446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708804868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d7e7da-01e5-42b3-983d-3547f1ae8783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:09Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38008e0-13ea-4ad8-ad58-a91a0c57097c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38008e0-13ea-4ad8-ad58-a91a0c57097c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e1cdd-37d1-4588-baa0-4fb3ea8ff490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e1cdd-37d1-4588-baa0-4fb3ea8ff490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d7e7da-01e5-42b3-983d-3547f1ae8783', 'volume_name': 'volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecf0647-10a5-4523-8527-86c803255d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecf0647-10a5-4523-8527-86c803255d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31f70f-ffac-4bfb-bc1e-83947005be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Volume d6d7e7da-01e5-42b3-983d-3547f1ae8783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783', 'volume_size': 1} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708804868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d7e7da-01e5-42b3-983d-3547f1ae8783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:09Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Creating volume d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:08 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:48:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:08 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 1073741824 Jul 06 15:48:08 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:09 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 1073741824" returned: 0 in 0.824s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:09 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 Jul 06 15:48:09 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:10 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783" returned: 0 in 0.622s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f31f70f-ffac-4bfb-bc1e-83947005be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a9b380-6a8e-4ac5-a381-dfb7b75bc153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:10 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Volume volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 (d6d7e7da-01e5-42b3-983d-3547f1ae8783): created successfully Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a9b380-6a8e-4ac5-a381-dfb7b75bc153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (7b6e852c-ed4e-4383-a34a-6ea3065780be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-0314fddd-00e6-43b2-b2dd-658c40dd29b7 tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Creating offline snapshot f68c2aed-f10f-4b2c-b637-08a8131b3f77 of volume d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[080432ee-1d23-4092-9a89-a8777b0c734e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:11 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 Jul 06 15:48:11 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:11 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783" returned: 0 in 0.770s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:11 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 1G Jul 06 15:48:11 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:12 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 1G" returned: 0 in 0.798s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:12 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 Jul 06 15:48:12 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:13 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:13 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 is being set with open permissions: ugo+rw Jul 06 15:48:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:13 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 Jul 06 15:48:13 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:13 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77" returned: 0 in 0.614s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:13 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info Jul 06 15:48:13 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:14 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info" returned: 0 in 0.635s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:14 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info is being set with open permissions: ugo+rw Jul 06 15:48:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:14 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info Jul 06 15:48:14 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:15 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.info" returned: 0 in 0.628s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.205s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a11db55b-31b0-473a-82a3-78c863661b5a tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-f68c2aed-f10f-4b2c-b637-08a8131b3f77-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Lock "cinder-f68c2aed-f10f-4b2c-b637-08a8131b3f77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-d6d7e7da-01e5-42b3-983d-3547f1ae8783" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-d6d7e7da-01e5-42b3-983d-3547f1ae8783" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-f68c2aed-f10f-4b2c-b637-08a8131b3f77" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-f68c2aed-f10f-4b2c-b637-08a8131b3f77" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot f68c2aed-f10f-4b2c-b637-08a8131b3f77 of volume d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1152e173-ade1-4b24-a193-44bede477f83]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:16 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 Jul 06 15:48:16 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:17 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77" returned: 0 in 0.764s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:17 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f2118-8980-4370-acce-a2e11fd0feb4]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:17 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 Jul 06 15:48:17 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:17 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783" returned: 0 in 0.749s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:17 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 Jul 06 15:48:17 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:18 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77" returned: 0 in 0.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:18 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77 Jul 06 15:48:18 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:19 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783.f68c2aed-f10f-4b2c-b637-08a8131b3f77" returned: 0 in 0.671s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-f68c2aed-f10f-4b2c-b637-08a8131b3f77" released by "_delete_snapshot" :: held 3.014s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-d6d7e7da-01e5-42b3-983d-3547f1ae8783" released by "delete_snapshot" :: held 3.039s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:19 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Created reservations ['4e6a588b-4e8f-4444-8d0e-cd048b40bafb', '8c0dded9-bced-46ee-a055-885d18db9192', '9af17402-fe37-4c27-8f58-fe7f40378193', 'eb72f65c-757c-4bf2-b73e-53715c50234d'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:19 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:48:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9a0810e3-a51d-4501-9887-5c61ded5443a tempest-ProjectMemberTests-96922552 None] Lock "cinder-f68c2aed-f10f-4b2c-b637-08a8131b3f77-delete_snapshot" released by "delete_snapshot" :: held 3.205s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-d6d7e7da-01e5-42b3-983d-3547f1ae8783-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Lock "cinder-d6d7e7da-01e5-42b3-983d-3547f1ae8783-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-d6d7e7da-01e5-42b3-983d-3547f1ae8783" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:20 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-d6d7e7da-01e5-42b3-983d-3547f1ae8783" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a0cff-e51a-4a38-b6db-3c4f7d69fe1b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:20 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 Jul 06 15:48:20 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:21 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783" returned: 0 in 0.765s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:21 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783 Jul 06 15:48:21 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:21 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-d6d7e7da-01e5-42b3-983d-3547f1ae8783" returned: 0 in 0.616s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-d6d7e7da-01e5-42b3-983d-3547f1ae8783" released by "delete_volume" :: held 1.441s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Created reservations ['3dfe53a9-5bbf-4a5a-b946-0625c5ced8b3', 'eaa0fa70-5b97-44fe-969e-8c3cd35a92ab', 'b3b8dd60-97a4-4b92-b53a-dfa2ab02fd3c', '95b5970a-847d-4eb5-9cfa-53795d2d26ec'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:22 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:48:22 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:22 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.695s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:48:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5de4e036-8a3d-4297-a319-2ab54f0313fc tempest-ProjectMemberTests-96922552 None] Lock "cinder-d6d7e7da-01e5-42b3-983d-3547f1ae8783-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (3e56b6c9-b4c9-4f4a-933a-3516c229d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa963c9b-4b6a-4ed6-b38b-1f7f088984db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa963c9b-4b6a-4ed6-b38b-1f7f088984db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952976430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6c8706-339a-4609-8e01-63c721a47964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:23Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a0b439-c816-402a-823d-caab55e2221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a0b439-c816-402a-823d-caab55e2221e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43592c14-f7e6-4c7a-9514-e936fc909f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43592c14-f7e6-4c7a-9514-e936fc909f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6c8706-339a-4609-8e01-63c721a47964', 'volume_name': 'volume-2f6c8706-339a-4609-8e01-63c721a47964', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a25f378-b981-49cf-b40a-6efaf0749865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a25f378-b981-49cf-b40a-6efaf0749865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4689b60c-ef25-4a3b-8e36-41d4dd0b2274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:23 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Volume 2f6c8706-339a-4609-8e01-63c721a47964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6c8706-339a-4609-8e01-63c721a47964', 'volume_size': 1} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952976430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6c8706-339a-4609-8e01-63c721a47964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:23Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Creating volume 2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:23 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:48:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:23 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 1073741824 Jul 06 15:48:23 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:24 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 1073741824" returned: 0 in 0.826s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:24 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 Jul 06 15:48:24 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:24 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964" returned: 0 in 0.656s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4689b60c-ef25-4a3b-8e36-41d4dd0b2274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6c8706-339a-4609-8e01-63c721a47964', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8c4e48-3232-4092-a493-6cd11795a3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Volume volume-2f6c8706-339a-4609-8e01-63c721a47964 (2f6c8706-339a-4609-8e01-63c721a47964): created successfully Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8c4e48-3232-4092-a493-6cd11795a3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (3e56b6c9-b4c9-4f4a-933a-3516c229d16a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-6077f34a-e1cc-4a5b-9b8c-3c2ed2200551 tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:48:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Creating offline snapshot a490ab28-f552-40a5-a09a-baa7f456e223 of volume 2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84ca5f1-b60f-45eb-804e-e2086d48ba53]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:25 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 Jul 06 15:48:25 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:26 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964" returned: 0 in 0.763s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:26 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 1G Jul 06 15:48:26 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:27 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 1G" returned: 0 in 0.795s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6c8706-339a-4609-8e01-63c721a47964 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:27 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6c8706-339a-4609-8e01-63c721a47964 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 Jul 06 15:48:27 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:27 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f6c8706-339a-4609-8e01-63c721a47964 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223" returned: 0 in 0.679s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:27 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 is being set with open permissions: ugo+rw Jul 06 15:48:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:27 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 Jul 06 15:48:27 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:28 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223" returned: 0 in 0.611s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:28 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info Jul 06 15:48:28 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:28 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info" returned: 0 in 0.624s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:28 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info is being set with open permissions: ugo+rw Jul 06 15:48:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:28 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info Jul 06 15:48:28 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:29 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.info" returned: 0 in 0.628s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.184s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2476ab42-0e84-4bab-9f15-0093cbb0bcbd tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-a490ab28-f552-40a5-a09a-baa7f456e223-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Lock "cinder-a490ab28-f552-40a5-a09a-baa7f456e223-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-2f6c8706-339a-4609-8e01-63c721a47964" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-2f6c8706-339a-4609-8e01-63c721a47964" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-a490ab28-f552-40a5-a09a-baa7f456e223" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-a490ab28-f552-40a5-a09a-baa7f456e223" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot a490ab28-f552-40a5-a09a-baa7f456e223 of volume 2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[716fb654-c346-483d-98fd-967eaed35c3b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:30 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 Jul 06 15:48:30 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:31 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223" returned: 0 in 0.713s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f6c8706-339a-4609-8e01-63c721a47964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:31 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[26967620-f431-46d9-92ee-4228dfb19ee8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:31 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 Jul 06 15:48:31 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:32 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964" returned: 0 in 0.800s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:32 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 Jul 06 15:48:32 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:32 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223" returned: 0 in 0.711s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:33 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223 Jul 06 15:48:33 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:33 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964.a490ab28-f552-40a5-a09a-baa7f456e223" returned: 0 in 0.644s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-a490ab28-f552-40a5-a09a-baa7f456e223" released by "_delete_snapshot" :: held 2.959s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-2f6c8706-339a-4609-8e01-63c721a47964" released by "delete_snapshot" :: held 2.982s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Created reservations ['0c4a0f67-e600-4067-a826-0c03164db8db', 'ea8cf076-67f2-4117-9d00-a6d9e897cb6b', '234c8634-37c3-4ed9-802d-65a42a04bec0', 'b2bede5d-7052-414e-a9e3-2f917c2516e6'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-59ee142a-e909-477a-a87d-62e1c6a8283c tempest-ProjectMemberTests-96922552 None] Lock "cinder-a490ab28-f552-40a5-a09a-baa7f456e223-delete_snapshot" released by "delete_snapshot" :: held 3.117s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-2f6c8706-339a-4609-8e01-63c721a47964-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-2f6c8706-339a-4609-8e01-63c721a47964-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-2f6c8706-339a-4609-8e01-63c721a47964" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-2f6c8706-339a-4609-8e01-63c721a47964" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[62016eef-ff26-4315-b51e-830de6e1287c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:34 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 Jul 06 15:48:34 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:34 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964" returned: 0 in 0.718s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:34 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964 Jul 06 15:48:34 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:35 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-2f6c8706-339a-4609-8e01-63c721a47964" returned: 0 in 0.613s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-2f6c8706-339a-4609-8e01-63c721a47964" released by "delete_volume" :: held 1.388s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Created reservations ['372c8c22-6728-4856-86d5-3fcc7ec17328', 'df97823a-0cc0-4ab1-946e-5c948219ac87', '7cedcf33-af90-49bf-bb98-d38f7e687f20', 'a6a8f7fb-d2f5-4d9a-9202-fba7b20cc5d2'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:35 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:48:35 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:36 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.645s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:36 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9682ddb6-438b-47e8-8a52-f428cc84fa4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-2f6c8706-339a-4609-8e01-63c721a47964-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (74f3870b-a30f-4fcd-adfd-985e4f3ca4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089763c2-67a9-4d45-bdcd-1e2d02d7885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089763c2-67a9-4d45-bdcd-1e2d02d7885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385536620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd1d5b1-e76e-485e-89e8-bacfba66332a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:37Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5803241-061b-4b7b-a11f-438e17707cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5803241-061b-4b7b-a11f-438e17707cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b62cb-8380-4c53-8056-803839056302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b62cb-8380-4c53-8056-803839056302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd1d5b1-e76e-485e-89e8-bacfba66332a', 'volume_name': 'volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dde0a2-f313-41ee-8353-0556e90ef7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8dde0a2-f313-41ee-8353-0556e90ef7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ffeae1-099d-4cb2-9d99-6b0fa35c4ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:36 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Volume 1cd1d5b1-e76e-485e-89e8-bacfba66332a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a', 'volume_size': 1} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-385536620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd1d5b1-e76e-485e-89e8-bacfba66332a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:37Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Creating volume 1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:36 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:48:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:36 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a 1073741824 Jul 06 15:48:36 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:37 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a 1073741824" returned: 0 in 0.808s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:37 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a Jul 06 15:48:37 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:38 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a" returned: 0 in 0.627s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ffeae1-099d-4cb2-9d99-6b0fa35c4ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f7740a-c2db-457f-9b81-05dbf8d11b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:38 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Volume volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a (1cd1d5b1-e76e-485e-89e8-bacfba66332a): created successfully Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f7740a-c2db-457f-9b81-05dbf8d11b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (74f3870b-a30f-4fcd-adfd-985e4f3ca4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-384fba39-1d85-4f4b-9635-7c2df5501c7d tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Creating offline snapshot 85affe74-a40c-4dae-9c72-7c63b535d888 of volume 1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[58992445-7de8-46b1-b492-76e649944bca]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:38 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a Jul 06 15:48:38 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:39 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a" returned: 0 in 0.746s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:39 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 1G Jul 06 15:48:39 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:40 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 1G" returned: 0 in 0.769s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:40 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 Jul 06 15:48:40 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:41 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888" returned: 0 in 0.638s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:41 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 is being set with open permissions: ugo+rw Jul 06 15:48:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:41 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 Jul 06 15:48:41 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:41 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:41 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info Jul 06 15:48:41 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:42 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info" returned: 0 in 0.623s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:42 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info is being set with open permissions: ugo+rw Jul 06 15:48:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:42 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info Jul 06 15:48:42 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:42 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.info" returned: 0 in 0.623s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ecd16298-3880-47d3-a6c6-2f9b92c0d689 tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-85affe74-a40c-4dae-9c72-7c63b535d888-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Lock "cinder-85affe74-a40c-4dae-9c72-7c63b535d888-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-1cd1d5b1-e76e-485e-89e8-bacfba66332a" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1cd1d5b1-e76e-485e-89e8-bacfba66332a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-85affe74-a40c-4dae-9c72-7c63b535d888" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-85affe74-a40c-4dae-9c72-7c63b535d888" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot 85affe74-a40c-4dae-9c72-7c63b535d888 of volume 1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee8dec-3a4d-4f73-a1b6-bd617c37ad40]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:44 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 Jul 06 15:48:44 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:44 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888" returned: 0 in 0.719s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[de152da7-2545-4c32-9120-c9d80586dd0c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:44 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a Jul 06 15:48:44 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:45 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a" returned: 0 in 0.743s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:45 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 Jul 06 15:48:45 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:46 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888" returned: 0 in 0.735s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:46 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888 Jul 06 15:48:46 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:46 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a.85affe74-a40c-4dae-9c72-7c63b535d888" returned: 0 in 0.609s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-85affe74-a40c-4dae-9c72-7c63b535d888" released by "_delete_snapshot" :: held 2.893s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1cd1d5b1-e76e-485e-89e8-bacfba66332a" released by "delete_snapshot" :: held 2.915s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Created reservations ['0656b5dd-d972-4391-924d-0aacbb29be38', '784062cd-614d-4de7-b5f4-cc9acb6675d3', '9a3acaa1-22fa-491c-a501-0c8e619e9ca8', '9473b5ea-84c8-41b4-8d92-5fd0119c1f9c'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:47 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a07f8d3d-be30-46d0-a26f-67dd3d745120 tempest-ProjectMemberTests-96922552 None] Lock "cinder-85affe74-a40c-4dae-9c72-7c63b535d888-delete_snapshot" released by "delete_snapshot" :: held 3.038s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-1cd1d5b1-e76e-485e-89e8-bacfba66332a-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Lock "cinder-1cd1d5b1-e76e-485e-89e8-bacfba66332a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-1cd1d5b1-e76e-485e-89e8-bacfba66332a" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1cd1d5b1-e76e-485e-89e8-bacfba66332a" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31fed14-9188-46be-ba28-ae8ba482867c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:47 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a Jul 06 15:48:47 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:48 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a" returned: 0 in 0.730s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:48 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a Jul 06 15:48:48 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:48 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1cd1d5b1-e76e-485e-89e8-bacfba66332a" returned: 0 in 0.653s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-1cd1d5b1-e76e-485e-89e8-bacfba66332a" released by "delete_volume" :: held 1.443s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Created reservations ['bb0ac24c-2bc8-455f-ae7a-59645b54c641', 'd3b68605-8c80-45c2-80eb-6cce63634535', '447770bf-2dfc-4928-b65a-e95e7c7077fa', '0c1a3420-621a-45ba-ad41-82adff5388c2'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:48 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:48:48 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:49 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.641s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:48:49 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-1c0a3c01-8611-4473-92f2-f0d18f066d10 tempest-ProjectMemberTests-96922552 None] Lock "cinder-1cd1d5b1-e76e-485e-89e8-bacfba66332a-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (f84591fb-37cf-494f-8c7c-6a12fe3b0bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275b72af-2702-408f-9c07-e7f601dc5b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275b72af-2702-408f-9c07-e7f601dc5b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184915980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:50Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86edb23d-51c3-4f2a-ab39-a64fb9099ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86edb23d-51c3-4f2a-ab39-a64fb9099ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46498530-df9c-4890-a6e0-fa3a62d32cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46498530-df9c-4890-a6e0-fa3a62d32cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad', 'volume_name': 'volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c54fe9-350b-43a8-a23b-e900a9f7f0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c54fe9-350b-43a8-a23b-e900a9f7f0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee93066c-8186-456e-860f-02d754521167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:49 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Volume 9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad', 'volume_size': 1} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1184915980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:48:50Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Creating volume 9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:48:49 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:48:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:49 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad 1073741824 Jul 06 15:48:49 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:50 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad 1073741824" returned: 0 in 0.788s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:50 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad Jul 06 15:48:50 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:51 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" returned: 0 in 0.644s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee93066c-8186-456e-860f-02d754521167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb14c385-a52a-4660-b5bf-bc69cdc748be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:48:51 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Volume volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad (9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad): created successfully Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb14c385-a52a-4660-b5bf-bc69cdc748be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:48:51 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (f84591fb-37cf-494f-8c7c-6a12fe3b0bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:48:51 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-30206ca8-ba39-465b-89ed-811c9cb9f75d tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Creating offline snapshot 08176f26-6710-4f2c-8f23-dc4c27d0c7a8 of volume 9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcf95d6-8d3a-40cf-a4f1-abdc9d977e3c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:52 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad Jul 06 15:48:52 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:52 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" returned: 0 in 0.745s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:52 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 1G Jul 06 15:48:52 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:53 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 1G" returned: 0 in 0.791s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:53 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 Jul 06 15:48:53 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:54 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8" returned: 0 in 0.655s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:54 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 is being set with open permissions: ugo+rw Jul 06 15:48:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:54 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 Jul 06 15:48:54 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:54 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8" returned: 0 in 0.659s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:55 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info Jul 06 15:48:55 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:55 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info" returned: 0 in 0.615s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:55 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info is being set with open permissions: ugo+rw Jul 06 15:48:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:55 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info Jul 06 15:48:55 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:56 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.info" returned: 0 in 0.630s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.170s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:48:56 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d891c530-e4af-4bd5-975d-1235531f4523 tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-08176f26-6710-4f2c-8f23-dc4c27d0c7a8-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Lock "cinder-08176f26-6710-4f2c-8f23-dc4c27d0c7a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-08176f26-6710-4f2c-8f23-dc4c27d0c7a8" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-08176f26-6710-4f2c-8f23-dc4c27d0c7a8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot 08176f26-6710-4f2c-8f23-dc4c27d0c7a8 of volume 9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb0c76f-6e87-4974-ac83-9abdbeac6d19]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:57 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 Jul 06 15:48:57 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:58 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8" returned: 0 in 0.726s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:48:58 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f6130-fd07-4da2-b5b5-83d69206436e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:48:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:58 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad Jul 06 15:48:58 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:58 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" returned: 0 in 0.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:58 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 Jul 06 15:48:58 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:48:59 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 06 15:48:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8" returned: 0 in 0.698s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:48:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:48:59 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8 Jul 06 15:48:59 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:00 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad.08176f26-6710-4f2c-8f23-dc4c27d0c7a8" returned: 0 in 0.612s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-08176f26-6710-4f2c-8f23-dc4c27d0c7a8" released by "_delete_snapshot" :: held 2.854s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" released by "delete_snapshot" :: held 2.876s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Created reservations ['9bb8d6e6-9e02-45f6-a021-47e7c72cb356', '7fce02e7-fb8e-4e4b-82e3-daee68f21450', '6553f4df-f3fe-42fc-b70c-e647a0115f81', '499aad9d-effa-48db-b13d-89df47584195'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-9adee877-0237-4b4d-99d4-fdaa97d964bb tempest-ProjectMemberTests-96922552 None] Lock "cinder-08176f26-6710-4f2c-8f23-dc4c27d0c7a8-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[01798d6d-7813-4027-973a-eee2f5521b1d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:00 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad Jul 06 15:49:00 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:01 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" returned: 0 in 0.747s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:01 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad Jul 06 15:49:01 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:01 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" returned: 0 in 0.653s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:01 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad" released by "delete_volume" :: held 1.451s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:DELETE=6,cinder:SELECT=65,cinder:INSERT=21,cinder:UPDATE=77 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=61,cinder:INSERT=23,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Created reservations ['c04eec10-0af1-4c79-8360-4d5f11b7cd88', '7db76d02-01a5-491b-915a-f3c4d44315a7', '603faa83-000a-4bad-95ee-6b65ae4994f8', 'b7ad87c9-3c83-4a6f-9f1b-594332c2e50e'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:02 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:49:02 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:02 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.659s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:02 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:49:02 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-5a1eb3a8-b8c3-44c1-9b5c-1645e35e4c4f tempest-ProjectMemberTests-96922552 None] Lock "cinder-9f69c5b4-2cab-4f1e-998c-b0bd8cfe0bad-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (77083e33-5dd8-4251-b7d5-4d5b29bf01fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364edfab-d4e5-4a00-a11b-67e3f35e36fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (364edfab-d4e5-4a00-a11b-67e3f35e36fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77213561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d977b9-5f58-4acd-a39a-66cdacd36f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:03Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba43f1c-52ec-4886-8fae-a4990c2d6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba43f1c-52ec-4886-8fae-a4990c2d6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c6b62c-d104-4b3d-a980-ace34210711e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c6b62c-d104-4b3d-a980-ace34210711e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d977b9-5f58-4acd-a39a-66cdacd36f0e', 'volume_name': 'volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ac2277-fc9a-4e9f-a022-6dced5695fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ac2277-fc9a-4e9f-a022-6dced5695fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44041a02-d81b-4865-854b-1b6d81d88a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:03 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Volume b1d977b9-5f58-4acd-a39a-66cdacd36f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e', 'volume_size': 1} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77213561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d977b9-5f58-4acd-a39a-66cdacd36f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673366acf17482a9bbeae5f2d898658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:03Z,use_quota=True,user_id='786375003030466f801280942db4f0c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Creating volume b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:03 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:49:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:03 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e 1073741824 Jul 06 15:49:03 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:04 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e 1073741824" returned: 0 in 0.831s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:04 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e Jul 06 15:49:04 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:04 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" returned: 0 in 0.635s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44041a02-d81b-4865-854b-1b6d81d88a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add9965c-26fc-4102-9b96-5f91b4fb94ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:04 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Volume volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e (b1d977b9-5f58-4acd-a39a-66cdacd36f0e): created successfully Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add9965c-26fc-4102-9b96-5f91b4fb94ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:04 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Flow 'volume_create_manager' (77083e33-5dd8-4251-b7d5-4d5b29bf01fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:04 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8ac431f0-5674-4d2d-8a22-4d8e4005f199 tempest-ProjectMemberTests-96922552 None] Created volume successfully. Jul 06 15:49:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:05 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Creating offline snapshot 16b3a1da-23cf-44b0-a30a-2c2b1e128d89 of volume b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:05 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1937a2b-c2f0-497d-8379-31de5118bc1d]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:05 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e Jul 06 15:49:05 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:06 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" returned: 0 in 0.728s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:06 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 1G Jul 06 15:49:06 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:06 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 1G" returned: 0 in 0.749s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:06 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:49:06 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:06 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 Jul 06 15:49:06 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:07 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.642s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:49:07 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89" returned: 0 in 0.673s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:07 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 is being set with open permissions: ugo+rw Jul 06 15:49:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:07 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 Jul 06 15:49:07 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:08 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89" returned: 0 in 0.595s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:08 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info Jul 06 15:49:08 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:08 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info" returned: 0 in 0.608s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:08 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info is being set with open permissions: ugo+rw Jul 06 15:49:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:08 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info Jul 06 15:49:08 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:09 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.info" returned: 0 in 0.602s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.027s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-9ea27a11-97ad-4f5f-ad85-341d374c5057 tempest-ProjectMemberTests-96922552 None] Create snapshot completed successfully Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-16b3a1da-23cf-44b0-a30a-2c2b1e128d89-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Lock "cinder-16b3a1da-23cf-44b0-a30a-2c2b1e128d89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-16b3a1da-23cf-44b0-a30a-2c2b1e128d89" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-16b3a1da-23cf-44b0-a30a-2c2b1e128d89" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Deleting offline snapshot 16b3a1da-23cf-44b0-a30a-2c2b1e128d89 of volume b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] snapshot_file for this snap is: volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53d8b5-1cfc-4026-929c-61256179f19a]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:09 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 Jul 06 15:49:09 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:10 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89" returned: 0 in 0.731s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:10 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37cf175-8346-4c9a-a103-257c33f2ead8]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:10 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e Jul 06 15:49:10 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:11 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" returned: 0 in 0.715s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:11 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 Jul 06 15:49:11 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:11 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89" returned: 0 in 0.682s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:11 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89 Jul 06 15:49:11 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:12 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e.16b3a1da-23cf-44b0-a30a-2c2b1e128d89" returned: 0 in 0.606s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-16b3a1da-23cf-44b0-a30a-2c2b1e128d89" released by "_delete_snapshot" :: held 2.821s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" released by "delete_snapshot" :: held 2.842s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Created reservations ['3c5e75e1-05ff-409c-89ea-9f752a21222e', '9e9b6d98-69ed-4bab-a9f5-9184dc4bd2c5', '4b3cf34c-cb77-413e-8c73-8ed07e533724', '70cc947e-d71e-4b56-ac6a-86ecb53dce73'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:12 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Delete snapshot completed successfully. Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b9ca8d9a-7fdd-4f8b-bf69-e787f80e9aa7 tempest-ProjectMemberTests-96922552 None] Lock "cinder-16b3a1da-23cf-44b0-a30a-2c2b1e128d89-delete_snapshot" released by "delete_snapshot" :: held 2.962s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-b1d977b9-5f58-4acd-a39a-66cdacd36f0e-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-b1d977b9-5f58-4acd-a39a-66cdacd36f0e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Acquiring lock "cinder-quobyte-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" acquired by "delete_volume" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9452d2-7eaf-4e46-acf9-7093d9f8fbc2]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:13 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e Jul 06 15:49:13 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:13 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" returned: 0 in 0.716s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:13 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e Jul 06 15:49:13 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:14 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" returned: 0 in 0.612s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-quobyte-b1d977b9-5f58-4acd-a39a-66cdacd36f0e" released by "delete_volume" :: held 1.387s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Created reservations ['be05e68a-2259-47b4-b2f4-947044f3482e', 'afe70143-2b4c-4678-a179-4a6b2bf88750', '408a23f5-52c7-4da2-9d65-96362864ba85', '142f81f6-e65a-464a-9e4c-a800f0bf0302'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:14 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:49:14 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:15 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.641s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:15 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Deleted volume successfully. Jul 06 15:49:15 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-fff673a6-e9b9-46f9-b490-5a87028d97b4 tempest-ProjectMemberTests-96922552 None] Lock "cinder-b1d977b9-5f58-4acd-a39a-66cdacd36f0e-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (b8ab651a-956c-4a01-a06d-de0d1b40c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184641ff-fc15-416a-a5e8-9caa10b038b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184641ff-fc15-416a-a5e8-9caa10b038b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585582093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5586959b-bd36-45b6-aeba-d8fed0b371fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:19Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a0c93e-005f-4159-a55d-d07cb58c6128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a0c93e-005f-4159-a55d-d07cb58c6128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87400e9-9679-4226-a5ca-44fb0cec0472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87400e9-9679-4226-a5ca-44fb0cec0472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5586959b-bd36-45b6-aeba-d8fed0b371fb', 'volume_name': 'volume-5586959b-bd36-45b6-aeba-d8fed0b371fb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aee627a-c939-4985-9cff-0b5aaa947caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aee627a-c939-4985-9cff-0b5aaa947caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e3f7ec-64e9-47e2-a15d-711688681b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:18 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Volume 5586959b-bd36-45b6-aeba-d8fed0b371fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5586959b-bd36-45b6-aeba-d8fed0b371fb', 'volume_size': 1} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1585582093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5586959b-bd36-45b6-aeba-d8fed0b371fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:19Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Creating volume 5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:18 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:49:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:18 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb 1073741824 Jul 06 15:49:18 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:19 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb 1073741824" returned: 0 in 0.792s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:19 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb Jul 06 15:49:19 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:20 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb" returned: 0 in 0.626s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e3f7ec-64e9-47e2-a15d-711688681b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5586959b-bd36-45b6-aeba-d8fed0b371fb', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b710c4c-1501-49a7-8dfa-cf0f91cdd4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:20 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Volume volume-5586959b-bd36-45b6-aeba-d8fed0b371fb (5586959b-bd36-45b6-aeba-d8fed0b371fb): created successfully Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b710c4c-1501-49a7-8dfa-cf0f91cdd4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (b8ab651a-956c-4a01-a06d-de0d1b40c21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:20 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8938ab42-cdcf-4f34-87a2-eea70fdc8ac2 tempest-ProjectReaderTests-2115555848 None] Created volume successfully. Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Creating offline snapshot fc953292-78cc-4dac-a5c2-d245ad04a5d5 of volume 5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eb193d-0dc3-442b-a88b-62ab0af4ff0b]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:21 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb Jul 06 15:49:21 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:21 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb" returned: 0 in 0.712s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:21 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 1G Jul 06 15:49:21 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:22 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 1G" returned: 0 in 0.763s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5586959b-bd36-45b6-aeba-d8fed0b371fb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:22 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5586959b-bd36-45b6-aeba-d8fed0b371fb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 Jul 06 15:49:22 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:23 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5586959b-bd36-45b6-aeba-d8fed0b371fb -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5" returned: 0 in 0.646s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:23 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 is being set with open permissions: ugo+rw Jul 06 15:49:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:23 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 Jul 06 15:49:23 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:23 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5" returned: 0 in 0.619s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:23 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info Jul 06 15:49:23 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:24 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info" returned: 0 in 0.662s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:24 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info is being set with open permissions: ugo+rw Jul 06 15:49:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:24 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info Jul 06 15:49:24 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:25 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.info" returned: 0 in 0.661s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.134s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:25 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a4bc3c01-5a5b-44f9-9b3b-94232446f28f tempest-ProjectReaderTests-2115555848 None] Create snapshot completed successfully Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-fc953292-78cc-4dac-a5c2-d245ad04a5d5-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Lock "cinder-fc953292-78cc-4dac-a5c2-d245ad04a5d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-5586959b-bd36-45b6-aeba-d8fed0b371fb" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-5586959b-bd36-45b6-aeba-d8fed0b371fb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-fc953292-78cc-4dac-a5c2-d245ad04a5d5" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-fc953292-78cc-4dac-a5c2-d245ad04a5d5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Deleting offline snapshot fc953292-78cc-4dac-a5c2-d245ad04a5d5 of volume 5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] snapshot_file for this snap is: volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadb9ddb-df47-487b-b06d-70ba06cac82f]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:26 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 Jul 06 15:49:26 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:27 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5" returned: 0 in 0.715s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:27 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5586959b-bd36-45b6-aeba-d8fed0b371fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:27 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[918db962-cc9f-41a4-a356-e166326613f0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:27 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb Jul 06 15:49:27 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:27 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb" returned: 0 in 0.747s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:27 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 Jul 06 15:49:27 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:28 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5" returned: 0 in 0.750s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:28 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5 Jul 06 15:49:28 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:29 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb.fc953292-78cc-4dac-a5c2-d245ad04a5d5" returned: 0 in 0.607s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-fc953292-78cc-4dac-a5c2-d245ad04a5d5" released by "_delete_snapshot" :: held 2.909s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-5586959b-bd36-45b6-aeba-d8fed0b371fb" released by "delete_snapshot" :: held 2.929s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Created reservations ['63799638-a13f-42e0-9648-443a74305807', '2b80d434-503e-40a3-bb11-7e1d845086c4', '5cbcaa6b-a15e-45fa-aa36-668628754b37', 'c3e6b193-3f97-4c4e-9b1d-0db36644bfb9'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:29 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Delete snapshot completed successfully. Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb22ffcd-a49f-4125-b71d-bf1ac1d41aec tempest-ProjectReaderTests-2115555848 None] Lock "cinder-fc953292-78cc-4dac-a5c2-d245ad04a5d5-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-5586959b-bd36-45b6-aeba-d8fed0b371fb-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-5586959b-bd36-45b6-aeba-d8fed0b371fb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-5586959b-bd36-45b6-aeba-d8fed0b371fb" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-5586959b-bd36-45b6-aeba-d8fed0b371fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b5cab7-605c-410f-a89e-f699d2a27d83]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:29 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb Jul 06 15:49:29 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:30 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb" returned: 0 in 0.724s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:30 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb Jul 06 15:49:30 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:30 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-5586959b-bd36-45b6-aeba-d8fed0b371fb" returned: 0 in 0.698s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:30 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-5586959b-bd36-45b6-aeba-d8fed0b371fb" released by "delete_volume" :: held 1.476s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:30 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Created reservations ['985d2844-ef8d-4d46-ab80-9cb925a40b62', 'bfbea9f6-d399-419b-bfde-3951f8f78626', '80b61124-130f-4c86-ba6b-1b534e02d291', '1c10eddb-b15c-47bd-9b94-08ffc747ff91'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:31 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:49:31 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:31 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.661s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Deleted volume successfully. Jul 06 15:49:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-ae0b1964-69f8-4651-b7a7-881413499757 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-5586959b-bd36-45b6-aeba-d8fed0b371fb-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (fcc5cf41-87fd-457a-aa4d-7a38b8a02023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e752f9b2-5c28-4487-95f5-efbfeb72e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e752f9b2-5c28-4487-95f5-efbfeb72e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188272003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbf82a3-df74-444b-a98a-8fd6fcc64812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:32Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffa563f-2fbd-4fb7-9873-8ce0493df060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffa563f-2fbd-4fb7-9873-8ce0493df060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae04706-d79b-4c0d-ad38-9980d877833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae04706-d79b-4c0d-ad38-9980d877833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bbf82a3-df74-444b-a98a-8fd6fcc64812', 'volume_name': 'volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2c4d1-cfd1-4aa0-b10a-b96145aec5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c2c4d1-cfd1-4aa0-b10a-b96145aec5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b0138-0131-471a-aaee-a5db6fe74b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:32 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Volume 1bbf82a3-df74-444b-a98a-8fd6fcc64812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812', 'volume_size': 1} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188272003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbf82a3-df74-444b-a98a-8fd6fcc64812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:32Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Creating volume 1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:32 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:32 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 1073741824 Jul 06 15:49:32 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:32 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 1073741824" returned: 0 in 0.842s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:33 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 Jul 06 15:49:33 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:33 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812" returned: 0 in 0.684s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59b0138-0131-471a-aaee-a5db6fe74b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446c8b9f-2a02-4122-904b-61a4100ab5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:33 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Volume volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 (1bbf82a3-df74-444b-a98a-8fd6fcc64812): created successfully Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446c8b9f-2a02-4122-904b-61a4100ab5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:33 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (fcc5cf41-87fd-457a-aa4d-7a38b8a02023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:33 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2ddf9829-7d68-4b64-8202-d21f40e27a9a tempest-ProjectReaderTests-2115555848 None] Created volume successfully. Jul 06 15:49:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:34 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Creating offline snapshot bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 of volume 1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:34 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d2e69-76e5-4561-a199-cc7e9fc0eda7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:34 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 Jul 06 15:49:34 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:35 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812" returned: 0 in 0.789s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:35 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 1G Jul 06 15:49:35 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:35 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 1G" returned: 0 in 0.816s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:35 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:35 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 Jul 06 15:49:35 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:36 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" returned: 0 in 0.695s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:36 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 is being set with open permissions: ugo+rw Jul 06 15:49:36 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:36 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 Jul 06 15:49:36 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:37 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" returned: 0 in 0.676s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:37 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:37 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info Jul 06 15:49:37 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:38 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info" returned: 0 in 0.671s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:38 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info is being set with open permissions: ugo+rw Jul 06 15:49:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:38 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info Jul 06 15:49:38 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:38 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.info" returned: 0 in 0.659s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:38 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:38 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-d4ac8fb6-2a97-41ad-87ba-9733f20c8682 tempest-ProjectReaderTests-2115555848 None] Create snapshot completed successfully Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Lock "cinder-bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-1bbf82a3-df74-444b-a98a-8fd6fcc64812" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-1bbf82a3-df74-444b-a98a-8fd6fcc64812" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Deleting offline snapshot bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 of volume 1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] snapshot_file for this snap is: volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f8100-aaa6-4076-9ee8-d90264feaccd]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:39 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:39 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 Jul 06 15:49:39 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:40 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" returned: 0 in 0.762s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:40 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:40 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45637a3-ec03-4e3c-bb86-525fb11be322]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:40 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:40 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 Jul 06 15:49:40 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:41 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812" returned: 0 in 0.810s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:41 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 Jul 06 15:49:41 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:41 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" returned: 0 in 0.775s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:41 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:41 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263 Jul 06 15:49:41 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:42 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:42 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812.bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" returned: 0 in 0.722s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263" released by "_delete_snapshot" :: held 3.160s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-1bbf82a3-df74-444b-a98a-8fd6fcc64812" released by "delete_snapshot" :: held 3.184s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:42 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Created reservations ['4bcde597-3324-4b57-9b35-ffd4f691404d', 'e2a4bc21-c291-4fe2-9308-4e5ea7e74c0e', 'd1bcd2d7-f37b-418b-b554-c0aff60f6789', 'dab06758-3a34-4fc7-a67e-bedc09f28033'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:42 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Delete snapshot completed successfully. Jul 06 15:49:42 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b0ad9ed2-9752-4c6d-b3ac-8e7fdd4f21ae tempest-ProjectReaderTests-2115555848 None] Lock "cinder-bc9ee7b6-8fb8-46bf-9654-d5c59d0eb263-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-1bbf82a3-df74-444b-a98a-8fd6fcc64812-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-1bbf82a3-df74-444b-a98a-8fd6fcc64812-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-1bbf82a3-df74-444b-a98a-8fd6fcc64812" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:43 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-1bbf82a3-df74-444b-a98a-8fd6fcc64812" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:43 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1d3a56-8191-46f8-b5a8-5477880b4ff0]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:43 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:43 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 Jul 06 15:49:43 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:44 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812" returned: 0 in 0.814s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:44 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:44 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812 Jul 06 15:49:44 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:45 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-1bbf82a3-df74-444b-a98a-8fd6fcc64812" returned: 0 in 0.660s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-1bbf82a3-df74-444b-a98a-8fd6fcc64812" released by "delete_volume" :: held 1.529s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Created reservations ['bf9a3917-1b11-4c3e-95e9-659024b540cc', '24ff8cb4-ac2e-42ac-83d0-19b519943138', '6893aa31-7cfa-424b-bd88-4ea11748f22a', '768d6fc3-8989-4d1b-9220-ce2a33a0f866'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:45 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:45 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:49:45 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:46 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.705s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:46 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Deleted volume successfully. Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-29cad92d-644a-475b-b937-394f9efca834 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-1bbf82a3-df74-444b-a98a-8fd6fcc64812-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (232455ae-df62-4fe1-b637-9da884221261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b340f3cc-06a9-4d8a-89c1-a418bab7c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b340f3cc-06a9-4d8a-89c1-a418bab7c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653327189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544df6c5-61bd-4229-ae16-0036798efca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:46Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5438ef5-82d8-4423-b874-4467f57a4eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5438ef5-82d8-4423-b874-4467f57a4eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e319488-6869-4331-8c65-548d01fcb4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e319488-6869-4331-8c65-548d01fcb4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544df6c5-61bd-4229-ae16-0036798efca6', 'volume_name': 'volume-544df6c5-61bd-4229-ae16-0036798efca6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0d0489-782e-4aca-a53c-18b48fa96a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0d0489-782e-4aca-a53c-18b48fa96a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85425383-84d0-4115-9802-a1e7dfe58c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:46 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Volume 544df6c5-61bd-4229-ae16-0036798efca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544df6c5-61bd-4229-ae16-0036798efca6', 'volume_size': 1} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653327189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544df6c5-61bd-4229-ae16-0036798efca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:46Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Creating volume 544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:46 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:49:46 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:46 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 1073741824 Jul 06 15:49:46 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:47 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 1073741824" returned: 0 in 0.795s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:47 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 Jul 06 15:49:47 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:47 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6" returned: 0 in 0.611s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85425383-84d0-4115-9802-a1e7dfe58c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544df6c5-61bd-4229-ae16-0036798efca6', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae09c91b-93e0-405e-a16f-ddaf40934742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:47 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Volume volume-544df6c5-61bd-4229-ae16-0036798efca6 (544df6c5-61bd-4229-ae16-0036798efca6): created successfully Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae09c91b-93e0-405e-a16f-ddaf40934742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:47 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (232455ae-df62-4fe1-b637-9da884221261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:48 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8cde2379-2077-4e33-86a8-0a9d64905b0e tempest-ProjectReaderTests-2115555848 None] Created volume successfully. Jul 06 15:49:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:48 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Creating offline snapshot e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b of volume 544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:49:48 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[362550db-0d9a-450c-8076-34f464c9f26e]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:48 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:48 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 Jul 06 15:49:48 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:49 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6" returned: 0 in 0.708s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:49 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:49 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b 1G Jul 06 15:49:49 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:50 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b 1G" returned: 0 in 0.741s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544df6c5-61bd-4229-ae16-0036798efca6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:50 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544df6c5-61bd-4229-ae16-0036798efca6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b Jul 06 15:49:50 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:50 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544df6c5-61bd-4229-ae16-0036798efca6 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" returned: 0 in 0.651s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:50 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b is being set with open permissions: ugo+rw Jul 06 15:49:50 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:50 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b Jul 06 15:49:50 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:51 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" returned: 0 in 0.610s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:51 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:51 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info Jul 06 15:49:51 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:52 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info" returned: 0 in 0.609s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:52 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info is being set with open permissions: ugo+rw Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:52 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info Jul 06 15:49:52 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:52 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.info" returned: 0 in 0.646s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.046s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:52 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-33db4847-d22c-4559-8156-6bac11e079e9 tempest-ProjectReaderTests-2115555848 None] Create snapshot completed successfully Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Lock "cinder-e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-544df6c5-61bd-4229-ae16-0036798efca6" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-544df6c5-61bd-4229-ae16-0036798efca6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Deleting offline snapshot e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b of volume 544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] snapshot_file for this snap is: volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8240ddd-405d-41f0-be97-303aa55b06c3]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:52 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:53 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b Jul 06 15:49:53 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:53 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" returned: 0 in 0.727s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:53 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544df6c5-61bd-4229-ae16-0036798efca6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:49:53 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b926e-0dce-4260-a3c5-e67674f6d086]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:53 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:53 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 Jul 06 15:49:53 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:54 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6" returned: 0 in 0.747s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:54 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:54 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b Jul 06 15:49:54 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:55 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" returned: 0 in 0.676s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:55 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b Jul 06 15:49:55 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:55 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6.e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" returned: 0 in 0.611s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b" released by "_delete_snapshot" :: held 2.841s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-544df6c5-61bd-4229-ae16-0036798efca6" released by "delete_snapshot" :: held 2.862s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Created reservations ['6556830c-c000-42bc-8600-d604c977bd51', 'e1f67277-7745-4178-af6d-902832d0cb12', '438cd09f-2ba4-49b6-8110-2f776122b6c9', '8c9ad746-f9e3-4852-9cfb-6c9e1c3d91aa'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:55 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Delete snapshot completed successfully. Jul 06 15:49:55 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-f8712b1e-64de-41dd-b593-19947a54f9ac tempest-ProjectReaderTests-2115555848 None] Lock "cinder-e0a30270-45c1-4a6c-aea1-1dcbdc1bf59b-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-544df6c5-61bd-4229-ae16-0036798efca6-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-544df6c5-61bd-4229-ae16-0036798efca6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-544df6c5-61bd-4229-ae16-0036798efca6" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-544df6c5-61bd-4229-ae16-0036798efca6" acquired by "delete_volume" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb55e7-70d8-4fa0-8880-432b611025e1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:56 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 Jul 06 15:49:56 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:56 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6" returned: 0 in 0.716s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:56 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:56 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6 Jul 06 15:49:56 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:57 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-544df6c5-61bd-4229-ae16-0036798efca6" returned: 0 in 0.614s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-544df6c5-61bd-4229-ae16-0036798efca6" released by "delete_volume" :: held 1.381s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Created reservations ['11409896-482b-46af-b6d2-6424c764db72', 'c2bc1993-2614-4401-acbf-2e15582291df', '17a5df3e-d7f8-42c7-97e8-639ec067205c', 'a2397621-4bd0-436b-a0b1-3aef13eb741b'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:57 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:57 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:49:57 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:58 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.613s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:49:58 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Deleted volume successfully. Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97c49ba8-a602-4de2-b34f-e33eb0462df8 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-544df6c5-61bd-4229-ae16-0036798efca6-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (0ea95e8f-751e-4856-85d5-50b5ae7795d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa829f0b-98f0-4d39-95a0-43cce9f2ad6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa829f0b-98f0-4d39-95a0-43cce9f2ad6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833715270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee1295f-d6d8-4c17-a199-488630c897b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:59Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e13a38-b433-4e5d-b842-a55d4dfe60a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e13a38-b433-4e5d-b842-a55d4dfe60a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d27419-43de-44c5-8daa-4c28756d14fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d27419-43de-44c5-8daa-4c28756d14fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee1295f-d6d8-4c17-a199-488630c897b0', 'volume_name': 'volume-7ee1295f-d6d8-4c17-a199-488630c897b0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d6d887-6a33-4af1-b75f-497ff1cd3314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d6d887-6a33-4af1-b75f-497ff1cd3314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58488165-4f40-4bdc-a279-75fa0937cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:49:58 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Volume 7ee1295f-d6d8-4c17-a199-488630c897b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee1295f-d6d8-4c17-a199-488630c897b0', 'volume_size': 1} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-833715270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee1295f-d6d8-4c17-a199-488630c897b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:49:59Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Creating volume 7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:49:58 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:49:58 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:58 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 1073741824 Jul 06 15:49:58 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:49:59 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 06 15:49:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 1073741824" returned: 0 in 0.780s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:49:59 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:49:59 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 Jul 06 15:49:59 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:00 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0" returned: 0 in 0.600s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58488165-4f40-4bdc-a279-75fa0937cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee1295f-d6d8-4c17-a199-488630c897b0', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0c83a0-d310-4ead-bdee-592b9107fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:00 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Volume volume-7ee1295f-d6d8-4c17-a199-488630c897b0 (7ee1295f-d6d8-4c17-a199-488630c897b0): created successfully Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0c83a0-d310-4ead-bdee-592b9107fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (0ea95e8f-751e-4856-85d5-50b5ae7795d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:00 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-876be4b0-aa1f-46c4-821f-9be2152a0898 tempest-ProjectReaderTests-2115555848 None] Created volume successfully. Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Creating offline snapshot 947e9b86-bd79-4310-8f5f-b9478450fe7d of volume 7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b485db6-6082-4aa7-80f3-9a57d3cff039]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:00 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:00 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 Jul 06 15:50:00 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:01 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0" returned: 0 in 0.738s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:01 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:01 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d 1G Jul 06 15:50:01 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:02 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d 1G" returned: 0 in 0.760s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:02 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee1295f-d6d8-4c17-a199-488630c897b0 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:02 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee1295f-d6d8-4c17-a199-488630c897b0 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d Jul 06 15:50:02 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:03 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee1295f-d6d8-4c17-a199-488630c897b0 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d" returned: 0 in 0.713s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:03 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d is being set with open permissions: ugo+rw Jul 06 15:50:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:03 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d Jul 06 15:50:03 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:03 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d" returned: 0 in 0.659s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:03 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=82,cinder:SELECT=65,cinder:DELETE=7,cinder:INSERT=14 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:03 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=60,cinder:INSERT=31,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:03 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:03 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info Jul 06 15:50:03 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:04 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info" returned: 0 in 0.643s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:04 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info is being set with open permissions: ugo+rw Jul 06 15:50:04 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:04 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info Jul 06 15:50:04 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:05 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.info" returned: 0 in 0.603s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:05 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:05 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-8ee53c40-790a-4bee-8a4b-d8c167044294 tempest-ProjectReaderTests-2115555848 None] Create snapshot completed successfully Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-947e9b86-bd79-4310-8f5f-b9478450fe7d-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Lock "cinder-947e9b86-bd79-4310-8f5f-b9478450fe7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-7ee1295f-d6d8-4c17-a199-488630c897b0" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-7ee1295f-d6d8-4c17-a199-488630c897b0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-947e9b86-bd79-4310-8f5f-b9478450fe7d" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-947e9b86-bd79-4310-8f5f-b9478450fe7d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Deleting offline snapshot 947e9b86-bd79-4310-8f5f-b9478450fe7d of volume 7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] snapshot_file for this snap is: volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb92b69-e95b-4d33-a194-1844841e9756]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:06 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d Jul 06 15:50:06 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:06 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d" returned: 0 in 0.738s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ee1295f-d6d8-4c17-a199-488630c897b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:50:06 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:50:06 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa63c7ff-7cd4-4d46-8f7e-28534d5aa5d5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:07 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 Jul 06 15:50:07 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:07 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.636s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:50:07 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0" returned: 0 in 0.791s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:07 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d Jul 06 15:50:07 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:08 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d" returned: 0 in 0.715s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:08 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d Jul 06 15:50:08 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:09 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0.947e9b86-bd79-4310-8f5f-b9478450fe7d" returned: 0 in 0.641s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-947e9b86-bd79-4310-8f5f-b9478450fe7d" released by "_delete_snapshot" :: held 2.981s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-7ee1295f-d6d8-4c17-a199-488630c897b0" released by "delete_snapshot" :: held 3.001s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Created reservations ['25085925-a1ba-4a9f-8b90-aa78af9fe609', 'c0cf3849-b9b8-4865-97f9-7fc09769476b', 'f6b30027-e9b3-4520-9b32-a150b6b87ece', '289a5f3f-80cc-4844-a579-125536b3eee7'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:09 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Delete snapshot completed successfully. Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-97d0cfc0-bd6f-4fd2-b115-bc46cfe13e3a tempest-ProjectReaderTests-2115555848 None] Lock "cinder-947e9b86-bd79-4310-8f5f-b9478450fe7d-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-7ee1295f-d6d8-4c17-a199-488630c897b0-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-7ee1295f-d6d8-4c17-a199-488630c897b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-7ee1295f-d6d8-4c17-a199-488630c897b0" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-7ee1295f-d6d8-4c17-a199-488630c897b0" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ad03c8-d625-490a-9770-3b57f434c540]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:09 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 Jul 06 15:50:09 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:10 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0" returned: 0 in 0.722s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:10 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0 Jul 06 15:50:10 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:10 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-7ee1295f-d6d8-4c17-a199-488630c897b0" returned: 0 in 0.609s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-7ee1295f-d6d8-4c17-a199-488630c897b0" released by "delete_volume" :: held 1.385s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Created reservations ['963ecf5a-d9f6-435c-81e0-248bd6b64cdd', 'f4ea9570-b05c-4a62-9924-f38adc1649c7', '5ebf6c40-db39-4cc9-a78c-4f2b8a69b974', 'b5a312ac-36ec-40fa-9b48-d705c7e9ddb8'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:10 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:50:10 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:11 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.630s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:50:11 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Deleted volume successfully. Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-a0f571f0-f7fc-4eae-a309-2bff0777c720 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-7ee1295f-d6d8-4c17-a199-488630c897b0-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (d377c2de-ba21-4240-a7a4-1e75814eda38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbeb0d5-a868-40aa-a6b2-480c81cba75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afbeb0d5-a868-40aa-a6b2-480c81cba75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815898121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabcf508-a320-490e-9a72-26c57e34021d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:12Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b768c17a-bc25-4442-9e7a-ba223b70b978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b768c17a-bc25-4442-9e7a-ba223b70b978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db5797a-be49-4ffa-a0f3-08813f8db599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db5797a-be49-4ffa-a0f3-08813f8db599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabcf508-a320-490e-9a72-26c57e34021d', 'volume_name': 'volume-dabcf508-a320-490e-9a72-26c57e34021d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec75498-fe11-42d0-b5e5-10e3c2d76758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec75498-fe11-42d0-b5e5-10e3c2d76758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8042b868-83ff-4f1b-b6db-5aaf2e32e21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:11 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Volume dabcf508-a320-490e-9a72-26c57e34021d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabcf508-a320-490e-9a72-26c57e34021d', 'volume_size': 1} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815898121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabcf508-a320-490e-9a72-26c57e34021d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce9e14cbc8b4e43950ff9b718fc380c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:50:12Z,use_quota=True,user_id='91833ed3ece14edea78bced09e3e2f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Creating volume dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:50:11 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:50:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:12 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d 1073741824 Jul 06 15:50:12 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:12 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d 1073741824" returned: 0 in 0.805s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:12 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d Jul 06 15:50:12 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:13 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d" returned: 0 in 0.611s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8042b868-83ff-4f1b-b6db-5aaf2e32e21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabcf508-a320-490e-9a72-26c57e34021d', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd972969-af99-4c4a-869b-d0cbdeb13c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:50:13 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Volume volume-dabcf508-a320-490e-9a72-26c57e34021d (dabcf508-a320-490e-9a72-26c57e34021d): created successfully Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd972969-af99-4c4a-869b-d0cbdeb13c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:50:13 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Flow 'volume_create_manager' (d377c2de-ba21-4240-a7a4-1e75814eda38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:50:13 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-5b3eac88-d417-47e9-879f-ca8720b5695e tempest-ProjectReaderTests-2115555848 None] Created volume successfully. Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Creating offline snapshot 388efadb-4218-432e-b4aa-5f752efe2239 of volume dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9faa2f-57ed-481b-954a-066ffb937fa1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:14 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d Jul 06 15:50:14 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:14 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d" returned: 0 in 0.740s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:14 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 1G Jul 06 15:50:14 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:15 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 1G" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabcf508-a320-490e-9a72-26c57e34021d -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:15 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabcf508-a320-490e-9a72-26c57e34021d -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 Jul 06 15:50:15 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:16 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dabcf508-a320-490e-9a72-26c57e34021d -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239" returned: 0 in 0.655s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:16 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 is being set with open permissions: ugo+rw Jul 06 15:50:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:16 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 Jul 06 15:50:16 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:16 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239" returned: 0 in 0.607s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:16 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info Jul 06 15:50:16 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:17 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info" returned: 0 in 0.613s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:17 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info is being set with open permissions: ugo+rw Jul 06 15:50:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:17 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info Jul 06 15:50:17 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:18 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.info" returned: 0 in 0.608s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.070s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:18 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7c8d2dcb-8f2a-4eb9-abd0-9c6b99a0b4fc tempest-ProjectReaderTests-2115555848 None] Create snapshot completed successfully Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-388efadb-4218-432e-b4aa-5f752efe2239-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-388efadb-4218-432e-b4aa-5f752efe2239-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-dabcf508-a320-490e-9a72-26c57e34021d" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-dabcf508-a320-490e-9a72-26c57e34021d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-388efadb-4218-432e-b4aa-5f752efe2239" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-388efadb-4218-432e-b4aa-5f752efe2239" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Deleting offline snapshot 388efadb-4218-432e-b4aa-5f752efe2239 of volume dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] snapshot_file for this snap is: volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd36c72b-0b47-44b3-9973-4e85b0d8ca95]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:19 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:19 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 Jul 06 15:50:19 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:20 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239" returned: 0 in 0.709s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:20 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dabcf508-a320-490e-9a72-26c57e34021d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:50:20 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6789f75-e88d-444e-a96a-e4230aa914e9]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:20 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d Jul 06 15:50:20 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:20 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d" returned: 0 in 0.758s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:20 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:20 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 Jul 06 15:50:20 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:21 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239" returned: 0 in 0.710s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:21 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:21 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239 Jul 06 15:50:21 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:22 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d.388efadb-4218-432e-b4aa-5f752efe2239" returned: 0 in 0.617s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-388efadb-4218-432e-b4aa-5f752efe2239" released by "_delete_snapshot" :: held 2.879s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-dabcf508-a320-490e-9a72-26c57e34021d" released by "delete_snapshot" :: held 2.902s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Created reservations ['d93dc1d2-671f-41d7-b80f-e9200891423d', '98f2143f-75bb-4d2a-aba0-1ed424f6680e', '4f7ab5a5-42c0-4f8c-be26-42c865a6b496', '4f97d3c5-63ca-4da1-903d-de085ebc142a'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:22 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Delete snapshot completed successfully. Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-e28219ff-c8e1-402f-8547-4dee575fefe1 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-388efadb-4218-432e-b4aa-5f752efe2239-delete_snapshot" released by "delete_snapshot" :: held 3.030s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-dabcf508-a320-490e-9a72-26c57e34021d-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-dabcf508-a320-490e-9a72-26c57e34021d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "cinder-quobyte-dabcf508-a320-490e-9a72-26c57e34021d" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-dabcf508-a320-490e-9a72-26c57e34021d" acquired by "delete_volume" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd47895f-0fdb-4e6f-809a-14ed124f1ef1]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:50:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:22 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d Jul 06 15:50:22 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:23 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d" returned: 0 in 0.723s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:23 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d Jul 06 15:50:23 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:23 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-dabcf508-a320-490e-9a72-26c57e34021d" returned: 0 in 0.628s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:23 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-quobyte-dabcf508-a320-490e-9a72-26c57e34021d" released by "delete_volume" :: held 1.404s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Created reservations ['77234348-8ace-45b9-8a73-7281e97bf5b5', '541223f5-e976-4334-bcce-746df88276b1', 'f56e206a-d5ef-46d6-a546-087132f9a532', '737610ee-60a4-4fff-8f1e-5ecb2af207f0'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:50:24 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:50:24 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:50:24 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.669s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:50:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Deleted volume successfully. Jul 06 15:50:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-dbba1039-abc1-4076-9a3a-8455343a2560 tempest-ProjectReaderTests-2115555848 None] Lock "cinder-dabcf508-a320-490e-9a72-26c57e34021d-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:50:34 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=24,cinder:INSERT=11,cinder:UPDATE=32,cinder:DELETE=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:50:34 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=25,cinder:DELETE=4,cinder:INSERT=8,cinder:UPDATE=32 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:06 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:51:06 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:07 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:07 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.685s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:07 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:51:07 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager._thread_info {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:51:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread count: 28 {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 15:51:07 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] thread info: [<_MainThread(MainThread, started 137257537466496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Flow 'volume_create_manager' (e1fda975-2bf7-4b20-93b6-d9aaca406f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf0ce0f-4f46-48cf-b292-7617d2142017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf0ce0f-4f46-48cf-b292-7617d2142017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2079779225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c22bfc4-7b48-4ac3-932f-afcc74479469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121c936e9bd47b2af8b4ed09da687d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:51:09Z,use_quota=True,user_id='be4164091d8545868618fe14a9c5599a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dd5527-0bd4-4e91-adce-807b41e05d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dd5527-0bd4-4e91-adce-807b41e05d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcca559f-b160-4652-9f4c-06761a6ba89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcca559f-b160-4652-9f4c-06761a6ba89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c22bfc4-7b48-4ac3-932f-afcc74479469', 'volume_name': 'volume-3c22bfc4-7b48-4ac3-932f-afcc74479469', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cee7950-dfd0-4863-8b6c-1d2a9c595b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cee7950-dfd0-4863-8b6c-1d2a9c595b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6614f07c-2fc8-400e-ab93-e355c77e4ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:08 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Volume 3c22bfc4-7b48-4ac3-932f-afcc74479469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c22bfc4-7b48-4ac3-932f-afcc74479469', 'volume_size': 1} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:51:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2079779225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c22bfc4-7b48-4ac3-932f-afcc74479469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121c936e9bd47b2af8b4ed09da687d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:51:09Z,use_quota=True,user_id='be4164091d8545868618fe14a9c5599a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)}" {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Creating volume 3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:51:08 devstack cinder-volume[86191]: INFO cinder.volume.drivers.remotefs [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] casted to osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 1073741824 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:08 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=1 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:51:08 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 1073741824 Jul 06 15:51:08 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:09 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 1073741824" returned: 0 in 0.858s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:09 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:09 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:09 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:10 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.690s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'} {{(pid=86191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6614f07c-2fc8-400e-ab93-e355c77e4ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c22bfc4-7b48-4ac3-932f-afcc74479469', 'volume_size': 1}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a92843b-fd7d-465d-bb9f-0038e80b052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:10 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Volume volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 (3c22bfc4-7b48-4ac3-932f-afcc74479469): created successfully Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a92843b-fd7d-465d-bb9f-0038e80b052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:10 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Flow 'volume_create_manager' (e1fda975-2bf7-4b20-93b6-d9aaca406f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:51:10 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b8c2aaf3-df0f-4231-ad05-6d8c81973f5d tempest-SnapshotDependencyTests-1396367032 None] Created volume successfully. Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Creating offline snapshot 48b0fd2f-e0f3-415e-9634-ad25bbdc4acb of volume 3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[70848ef8-af52-4026-a9d3-aa9ac4d62438]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:11 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:11 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:11 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.771s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:11 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb 1G {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:11 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb 1G Jul 06 15:51:11 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:12 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb 1G" returned: 0 in 0.838s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:12 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:12 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb Jul 06 15:51:12 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:13 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 -F qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" returned: 0 in 0.794s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:13 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb is being set with open permissions: ugo+rw Jul 06 15:51:13 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:13 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb Jul 06 15:51:13 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:14 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" returned: 0 in 0.674s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:14 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info Jul 06 15:51:14 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:14 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info" returned: 0 in 0.668s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:14 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info is being set with open permissions: ugo+rw Jul 06 15:51:14 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:14 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info Jul 06 15:51:14 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:15 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.info" returned: 0 in 0.644s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:15 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.479s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:15 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-7ab09c3c-c616-4900-b01e-655a22e95288 tempest-SnapshotDependencyTests-1396367032 None] Create snapshot completed successfully Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Flow 'volume_create_manager' (eae64b80-1cd2-4b67-9c86-ecf1d1881baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bbe2b7-5df7-4469-a892-a440638716b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59bbe2b7-5df7-4469-a892-a440638716b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8263065a-d074-46a2-b9fd-8d3b14f7ae51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0121c936e9bd47b2af8b4ed09da687d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48b0fd2f-e0f3-415e-9634-ad25bbdc4acb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T13:51:17Z,use_quota=True,user_id='be4164091d8545868618fe14a9c5599a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a6c24d4-fdc8-49ea-8bff-d992253d79b6),volume_type_id=7a6c24d4-fdc8-49ea-8bff-d992253d79b6)' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b9984e-fc33-4088-ac3f-31f7b358d27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b9984e-fc33-4088-ac3f-31f7b358d27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8f48e7-5258-4bb4-9997-872e084146ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8f48e7-5258-4bb4-9997-872e084146ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8263065a-d074-46a2-b9fd-8d3b14f7ae51', 'volume_name': 'volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51', 'volume_size': 1, 'snapshot_id': '48b0fd2f-e0f3-415e-9634-ad25bbdc4acb'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acc73e7-87a3-4932-929c-b0ef4b3cfed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7acc73e7-87a3-4932-929c-b0ef4b3cfed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fd596f-4ded-43f1-a778-f746179ba0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:16 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Volume 8263065a-d074-46a2-b9fd-8d3b14f7ae51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51', 'volume_size': 1, 'snapshot_id': '48b0fd2f-e0f3-415e-9634-ad25bbdc4acb'} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-quobyte-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb-8263065a-d074-46a2-b9fd-8d3b14f7ae51" by "_create_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb-8263065a-d074-46a2-b9fd-8d3b14f7ae51" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Creating volume 8263065a-d074-46a2-b9fd-8d3b14f7ae51 from snapshot 48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Selected osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f as target Quobyte volume. {{(pid=86191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-quobyte-8263065a-d074-46a2-b9fd-8d3b14f7ae51" by "_copy_volume_from_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-8263065a-d074-46a2-b9fd-8d3b14f7ae51" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] snapshot: 48b0fd2f-e0f3-415e-9634-ad25bbdc4acb, volume: 8263065a-d074-46a2-b9fd-8d3b14f7ae51, {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b589d-d43b-4cab-9532-135ffa8c40b5]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:16 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:17 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb Jul 06 15:51:17 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:17 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" returned: 0 in 0.774s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c22bfc4-7b48-4ac3-932f-afcc74479469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:51:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 15:51:17 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Creating direct copy from snapshot {{(pid=86191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 15:51:17 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[134919f7-4736-410c-9397-5377a2569403]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:17 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:17 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:17 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:18 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.786s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:18 devstack cinder-volume[86191]: DEBUG cinder.utils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Path /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 not found in is_blk_device check {{(pid=86191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 15:51:18 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:18 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 Jul 06 15:51:18 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:22 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51" returned: 0 in 4.400s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:22 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf8bbe4-4b05-4ea7-a7e4-43ad48732bce]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:22 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:22 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:23 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:23 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.976s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:23 devstack cinder-volume[86191]: DEBUG cinder.image.image_utils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Image conversion details: src /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 {{(pid=86191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 15:51:23 devstack cinder-volume[86191]: INFO cinder.image.image_utils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Converted 1024.00 MB image at 232.65 MB/s Jul 06 15:51:23 devstack cinder-volume[86191]: WARNING cinder.volume.drivers.remotefs [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 is being set with open permissions: ugo+rw Jul 06 15:51:23 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:23 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 Jul 06 15:51:23 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:24 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51" returned: 0 in 0.623s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-8263065a-d074-46a2-b9fd-8d3b14f7ae51" released by "_copy_volume_from_snapshot" :: held 7.647s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb-8263065a-d074-46a2-b9fd-8d3b14f7ae51" released by "_create_volume_from_snapshot" :: held 7.677s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.692s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fd596f-4ded-43f1-a778-f746179ba0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51', 'volume_size': 1, 'snapshot_id': '48b0fd2f-e0f3-415e-9634-ad25bbdc4acb'}' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c0a55-3bfb-4bfa-b299-737d27fecdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 15:51:24 devstack cinder-volume[86191]: INFO cinder.volume.flows.manager.create_volume [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Volume volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 (8263065a-d074-46a2-b9fd-8d3b14f7ae51): created successfully Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (305c0a55-3bfb-4bfa-b299-737d27fecdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 15:51:24 devstack cinder-volume[86191]: DEBUG cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Flow 'volume_create_manager' (eae64b80-1cd2-4b67-9c86-ecf1d1881baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 15:51:24 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-b073009a-23bd-4434-acb9-b32052d226da tempest-SnapshotDependencyTests-1396367032 None] Created volume successfully. Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb-delete_snapshot" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-quobyte-3c22bfc4-7b48-4ac3-932f-afcc74479469" by "delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-3c22bfc4-7b48-4ac3-932f-afcc74479469" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-quobyte-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" by "_delete_snapshot" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Deleting offline snapshot 48b0fd2f-e0f3-415e-9634-ad25bbdc4acb of volume 3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] snapshot_file for this snap is: volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3843e1-5e52-4344-9160-37e382377762]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:25 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:25 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb Jul 06 15:51:25 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:26 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" returned: 0 in 0.711s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:26 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.remotefs [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c22bfc4-7b48-4ac3-932f-afcc74479469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 15:51:26 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed372b0-2989-445c-a8c7-ee3156048f2c]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:26 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:26 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:26 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:27 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.764s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:27 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb Jul 06 15:51:27 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:27 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" returned: 0 in 0.803s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:27 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:27 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb Jul 06 15:51:27 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:28 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:28 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469.48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" returned: 0 in 0.630s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb" released by "_delete_snapshot" :: held 2.997s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-3c22bfc4-7b48-4ac3-932f-afcc74479469" released by "delete_snapshot" :: held 3.018s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:28 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Created reservations ['3dc31cee-1902-4125-a023-efcbcee27b79', '33679506-5d1a-4823-950d-dd85e7534010', '5b3f0556-1b69-4821-8a9f-3858bac6820f', '7ffc1819-2f6a-4009-a3d4-c498568414df'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:51:28 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Delete snapshot completed successfully. Jul 06 15:51:28 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-cb1aa07b-98a5-4695-83f9-1eb40a870643 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-48b0fd2f-e0f3-415e-9634-ad25bbdc4acb-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-3c22bfc4-7b48-4ac3-932f-afcc74479469-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-3c22bfc4-7b48-4ac3-932f-afcc74479469-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-quobyte-3c22bfc4-7b48-4ac3-932f-afcc74479469" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:29 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-3c22bfc4-7b48-4ac3-932f-afcc74479469" acquired by "delete_volume" :: waited 0.015s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:29 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[28233495-f972-4996-99c0-0bcafc88f8d7]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:29 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:29 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:29 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:30 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.729s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:30 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:30 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469 Jul 06 15:51:30 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:31 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-3c22bfc4-7b48-4ac3-932f-afcc74479469" returned: 0 in 0.645s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-3c22bfc4-7b48-4ac3-932f-afcc74479469" released by "delete_volume" :: held 1.431s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Created reservations ['c39d4d45-0e59-4ed5-aaa9-8909b0e85085', '70206bd0-cdc6-445e-aea1-3aa618883ad3', '6309777e-25c3-454a-bfd7-a36f08587301', 'e147166e-64ab-45e8-8a35-c3f33c53e257'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:31 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:51:31 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-8263065a-d074-46a2-b9fd-8d3b14f7ae51-delete_volume" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-8263065a-d074-46a2-b9fd-8d3b14f7ae51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:31 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.666s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:51:31 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Deleted volume successfully. Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "cinder-quobyte-8263065a-d074-46a2-b9fd-8d3b14f7ae51" by "delete_volume" {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-69f40888-af78-4498-8730-95477ef325e0 tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-3c22bfc4-7b48-4ac3-932f-afcc74479469-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:31 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-8263065a-d074-46a2-b9fd-8d3b14f7ae51" acquired by "delete_volume" :: waited 0.020s {{(pid=86191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 15:51:32 devstack cinder-volume[86191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f92a6-3873-4c29-9a9f-6aedcfa82e11]: (4, 'qcow2') {{(pid=87789) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 15:51:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:32 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 Jul 06 15:51:32 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:32 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51" returned: 0 in 0.740s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:32 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:32 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51 Jul 06 15:51:32 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:33 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f/volume-8263065a-d074-46a2-b9fd-8d3b14f7ae51" returned: 0 in 0.629s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-quobyte-8263065a-d074-46a2-b9fd-8d3b14f7ae51" released by "delete_volume" :: held 1.409s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG cinder.quota [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Created reservations ['30687760-8484-43c3-aefd-ff4aa6961245', 'b985aa3e-b49c-4a88-bc5c-02abd3331fef', '6e9925e6-4c83-4206-8019-21fe5c6b6be8', '07a59c20-2f60-4222-a506-75b44903dc10'] {{(pid=86191) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:51:33 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:51:33 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:51:33 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 15:51:34 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 06 15:51:34 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f" returned: 0 in 0.623s {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 15:51:34 devstack cinder-volume[86191]: DEBUG cinder.manager [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Notifying Schedulers of capabilities ... {{(pid=86191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 15:51:34 devstack cinder-volume[86191]: INFO cinder.volume.manager [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Deleted volume successfully. Jul 06 15:51:34 devstack cinder-volume[86191]: DEBUG cinder.coordination [None req-2d835f50-dc3e-4dbe-927a-4cdc95671aab tempest-SnapshotDependencyTests-1396367032 None] Lock "cinder-8263065a-d074-46a2-b9fd-8d3b14f7ae51-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86191) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 15:51:43 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:UPDATE=30,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:51:44 devstack cinder-volume[86191]: DEBUG dbcounter [-] [86191] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG oslo_service.periodic_task [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f': None} {{(pid=86191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG cinder.volume.drivers.quobyte [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d96006bf-d99c-42db-a376-cf08a581b01f'] {{(pid=86191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.lockutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 15:52:06 devstack cinder-volume[86191]: DEBUG oslo_concurrency.processutils [None req-a1bdb382-1a31-4e1b-b6d5-13e00cb93ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f {{(pid=86191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 15:52:06 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e376ad2beddf612ddee05ce3263d4a5f Jul 06 15:52:06 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)